Wozney, Lori M; Baxter, Pamela; Fast, Hilary; Cleghorn, Laura; Hundert, Amos S; Newton, Amanda S
2016-02-03
Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess "use in context" (ie, cognitive skills, usability understood over time) and in authentic "real world" settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting "real world" usability testing can lead to improved techniques and strategies To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. An exploratory case study approach was used to study 4 moderators' experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users.
2016-01-01
Background Research in the fields of human performance technology and human computer interaction are challenging the traditional macro focus of usability testing arguing for methods that help test moderators assess “use in context” (ie, cognitive skills, usability understood over time) and in authentic “real world” settings. Human factors in these complex test scenarios may impact on the quality of usability results being derived yet there is a lack of research detailing moderator experiences in these test environments. Most comparative research has focused on the impact of the physical environment on results, and rarely on how the sociotechnical elements of the test environment affect moderator and test user performance. Improving our understanding of moderator roles and experiences with conducting “real world” usability testing can lead to improved techniques and strategies Objective To understand moderator experiences of using Web-conferencing software to conduct remote usability testing of 2 eHealth interventions. Methods An exploratory case study approach was used to study 4 moderators’ experiences using Blackboard Collaborate for remote testing sessions of 2 different eHealth interventions. Data collection involved audio-recording iterative cycles of test sessions, collecting summary notes taken by moderators, and conducting 2 90-minute focus groups via teleconference. A direct content analysis with an inductive coding approach was used to explore personal accounts, assess the credibility of data interpretation, and generate consensus on the thematic structure of the results. Results Following the convergence of data from the various sources, 3 major themes were identified: (1) moderators experienced and adapted to unpredictable changes in cognitive load during testing; (2) moderators experienced challenges in creating and sustaining social presence and untangling dialogue; and (3) moderators experienced diverse technical demands, but were able to collaboratively troubleshoot with test users. Conclusions Results highlight important human-computer interactions and human factor qualities that impact usability testing processes. Moderators need an advanced skill and knowledge set to address the social interaction aspects of Web-based usability testing and technical aspects of conferencing software during test sessions. Findings from moderator-focused studies can inform the design of remote testing platforms and real-time usability evaluation processes that place less cognitive burden on moderators and test users. PMID:27026291
Chalil Madathil, Kapil; Greenstein, Joel S
2017-11-01
Collaborative virtual reality-based systems have integrated high fidelity voice-based communication, immersive audio and screen-sharing tools into virtual environments. Such three-dimensional collaborative virtual environments can mirror the collaboration among usability test participants and facilitators when they are physically collocated, potentially enabling moderated usability tests to be conducted effectively when the facilitator and participant are located in different places. We developed a virtual collaborative three-dimensional remote moderated usability testing laboratory and employed it in a controlled study to evaluate the effectiveness of moderated usability testing in a collaborative virtual reality-based environment with two other moderated usability testing methods: the traditional lab approach and Cisco WebEx, a web-based conferencing and screen sharing approach. Using a mixed methods experimental design, 36 test participants and 12 test facilitators were asked to complete representative tasks on a simulated online shopping website. The dependent variables included the time taken to complete the tasks; the usability defects identified and their severity; and the subjective ratings on the workload index, presence and satisfaction questionnaires. Remote moderated usability testing methodology using a collaborative virtual reality system performed similarly in terms of the total number of defects identified, the number of high severity defects identified and the time taken to complete the tasks with the other two methodologies. The overall workload experienced by the test participants and facilitators was the least with the traditional lab condition. No significant differences were identified for the workload experienced with the virtual reality and the WebEx conditions. However, test participants experienced greater involvement and a more immersive experience in the virtual environment than in the WebEx condition. The ratings for the virtual environment condition were not significantly different from those for the traditional lab condition. The results of this study suggest that participants were productive and enjoyed the virtual lab condition, indicating the potential of a virtual world based approach as an alternative to conventional approaches for synchronous usability testing. Copyright © 2017 Elsevier Ltd. All rights reserved.
Evaluation of Home Health Care Devices: Remote Usability Assessment.
Kortum, Philip; Peres, S Camille
2015-06-05
An increasing amount of health care is now performed in a home setting, away from the hospital. While there is growing anecdotal evidence about the difficulty patients and caregivers have using increasingly complex health care devices in the home, there has been little systematic scientific study to quantify the global nature of home health care device usability in the field. Research has tended to focus on a handful of devices, making it difficult to gain a broad view of the usability of home-care devices in general. The objective of this paper is to describe a remote usability assessment method using the System Usability Scale (SUS), and to report on the usability of a broad range of health care devices using this metric. A total of 271 participants selected and rated up to 10 home health care devices of their choice using the SUS, which scores usability from 0 (unusable) to 100 (highly usable). Participants rated a total of 455 devices in their own home without an experimenter present. Usability scores ranged from 98 (oxygen masks) to 59 (home hormone test kits). An analysis conducted on devices that had at least 10 ratings showed that the effect of device on SUS scores was significant (P<.001), and that the usability of these devices was on the low end when compared with other commonly used items in the home, such as microwave ovens and telephones. A large database of usability scores for home health care devices collected using this remote methodology would be beneficial for physicians, patients, and their caregivers.
Web usability testing with a Hispanic medically underserved population.
Moore, Mary; Bias, Randolph G; Prentice, Katherine; Fletcher, Robin; Vaughn, Terry
2009-04-01
Skilled website developers value usability testing to assure user needs are met. When the target audience differs substantially from the developers, it becomes essential to tailor both design and evaluation methods. In this study, researchers carried out a multifaceted usability evaluation of a website (Healthy Texas) designed for Hispanic audiences with lower computer literacy and lower health literacy. METHODS INCLUDED: (1) heuristic evaluation by a usability engineer, (2) remote end-user testing using WebEx software; and (3) face-to-face testing in a community center where use of the website was likely. Researchers found standard usability testing methods needed to be modified to provide interpreters, increased flexibility for time on task, presence of a trusted intermediary such as a librarian, and accommodation for family members who accompanied participants. Participants offered recommendations for website redesign, including simplified language, engaging and relevant graphics, culturally relevant examples, and clear navigation. User-centered design is especially important when website developers are not representative of the target audience. Failure to conduct appropriate usability testing with a representative audience can substantially reduce use and value of the website. This thorough course of usability testing identified improvements that benefit all users but become crucial when trying to reach an underserved audience.
Usability of Operational Performance Support Tools - Findings from Sea Test II
NASA Technical Reports Server (NTRS)
Byrne, Vicky; Litaker, Harry; McGuire, Kerry
2014-01-01
Sea Test II, aka NASA Extreme Environment Mission Operations 17(NEEMO 17) took place in the Florida Aquarius undersea habitat. This confined underwater environment provides a excellent analog for space habitation providing similarities to space habitation such as hostile environment, difficult logistics, autonomous operations, and remote communications. This study collected subjective feedback on the usability of two performance support tools during the Sea Test II mission, Sept 10-14, 2013; Google Glass and iPAD. The two main objectives: - Assess the overall functionality and usability of each performance support tool in a mission analog environment. - Assess the advantages and disadvantages of each tool when performing operational procedures and Just-In-Time-Training (JITT).
Wozney, Lori; Baxter, Pamela; Newton, Amanda S
2015-12-16
Use of the Internet to deliver cognitive behavioural therapy, a frontline treatment for anxiety disorders, is emerging as an option to increase access to treatment among adolescents with anxiety disorders. This study examined the usability of the Internet-based component of Breathe, a CBT program designed for adolescents with mild to moderate anxiety and impairments. A mixed-method usability testing design with semi-structured interviews, task completion, and survey by trained usability moderators was undertaken with two interactive cycles to determine the usability (ease of use, efficiency, errors, and user satisfaction) of the user interface and content areas of the program. Purposeful sampling was used to recruit mental health clinicians with expertise in treating adolescent anxiety disorders and young people aged 15 to 24 years involved. Testing involved using Web-conferencing software that allowed remote participation through personal computers. Two testing cycles involved participants completing structured 'think aloud' and 'cognitive walkthrough' tasks within the program. At the end of each cycle participants completed a 15-item global usability evaluation survey and were asked a series of open-ended questions. Descriptive and simple content analyses were used to identify and score usability issues for frequency and severity. Five clinicians and four young people (all < 20 years of age) participated. Most participants described their computer skills as 'good' (60% clinicians, 50% young people), and attitudes toward Internet-based health care ranged from negative (75% young people) to positive (60% clinicians, 25% young people). Scores from the global usability evaluation after both testing cycles ranged from 3.5 to 5 out of 5 in strong agreement/support of the program in terms of user performance indicators (i.e., learnability, efficiency and number of errors) and user satisfaction. Participants were able to complete all critical tasks with minimal errors. Errors and issues identified during testing were predominantly around enhancements to the visual design and navigational support. Opinions across usability elements did not differ between young people and clinician participants. A multi-method remote usability approach provided the opportunity to improve the technical interface, therapeutic messaging and user experience of an Internet-based treatment program for adolescent anxiety disorders.
Tree Testing of Hierarchical Menu Structures for Health Applications
Le, Thai; Chaudhuri, Shomir; Chung, Jane; Thompson, Hilaire J; Demiris, George
2014-01-01
To address the need for greater evidence-based evaluation of Health Information Technology (HIT) systems we introduce a method of usability testing termed tree testing. In a tree test, participants are presented with an abstract hierarchical tree of the system taxonomy and asked to navigate through the tree in completing representative tasks. We apply tree testing to a commercially available health application, demonstrating a use case and providing a comparison with more traditional in-person usability testing methods. Online tree tests (N=54) and in-person usability tests (N=15) were conducted from August to September 2013. Tree testing provided a method to quantitatively evaluate the information structure of a system using various navigational metrics including completion time, task accuracy, and path length. The results of the analyses compared favorably to the results seen from the traditional usability test. Tree testing provides a flexible, evidence-based approach for researchers to evaluate the information structure of HITs. In addition, remote tree testing provides a quick, flexible, and high volume method of acquiring feedback in a structured format that allows for quantitative comparisons. With the diverse nature and often large quantities of health information available, addressing issues of terminology and concept classifications during the early development process of a health information system will improve navigation through the system and save future resources. Tree testing is a usability method that can be used to quickly and easily assess information hierarchy of health information systems. PMID:24582924
Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning
NASA Astrophysics Data System (ADS)
Peters, Vanessa L.; Songer, Nancy Butler
2013-10-01
This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school students. To evaluate usability, we analyzed students' task performance and task completion time as they worked on an activity with the repurposed modeling technology. In stage 1, we conducted remote testing of an early modeling prototype with urban middle school students (n = 84). In stages 2 and 3, we used screencasting software to record students' mouse and keyboard movements during collaborative think-alouds (n = 22) and conducted a qualitative analysis of their peer discussions. Taken together, the study findings revealed two kinds of usability issues that interfered with students' productive use of the tool: issues related to the use of data and information, and issues related to the use of the modeling technology. The study findings resulted in design improvements that led to stronger usability outcomes and higher task performance among students. In this paper, we describe our methods for usability testing, our research findings, and our design solutions for supporting students' use of the modeling technology and use of data. The paper concludes with implications for the design and study of modeling technologies for science learning.
Evaluating Usability in a Distance Digital Systems Laboratory Class
ERIC Educational Resources Information Center
Kostaras, N.; Xenos, M.; Skodras, A. N.
2011-01-01
This paper presents the usability evaluation of a digital systems laboratory class offered to distance-learning students. It details the way in which students can participate remotely in such a laboratory, the methodology employed in the usability assessment of the laboratory infrastructure (hardware and software), and also outlines the main…
USDA-ARS?s Scientific Manuscript database
Because the Surface Energy Balance Algorithm for Land (SEBAL) tends to underestimate ET under conditions of advection, the model was modified by incorporating an advection component as part of the energy usable for crop evapotranspiration (ET). The modification involved the estimation of advected en...
Evaluation of Usability Utilizing Markov Models
ERIC Educational Resources Information Center
Penedo, Janaina Rodrigues; Diniz, Morganna; Ferreira, Simone Bacellar Leal; Silveira, Denis S.; Capra, Eliane
2012-01-01
Purpose: The purpose of this paper is to analyze the usability of a remote learning system in its initial development phase, using a quantitative usability evaluation method through Markov models. Design/methodology/approach: The paper opted for an exploratory study. The data of interest of the research correspond to the possible accesses of users…
Kushniruk, A W; Patel, C; Patel, V L; Cimino, J J
2001-04-01
The World Wide Web provides an unprecedented opportunity for widespread access to health-care applications by both patients and providers. The development of new methods for assessing the effectiveness and usability of these systems is becoming a critical issue. This paper describes the distance evaluation (i.e. 'televaluation') of emerging Web-based information technologies. In health informatics evaluation, there is a need for application of new ideas and methods from the fields of cognitive science and usability engineering. A framework is presented for conducting evaluations of health-care information technologies that integrates a number of methods, ranging from deployment of on-line questionnaires (and Web-based forms) to remote video-based usability testing of user interactions with clinical information systems. Examples illustrating application of these techniques are presented for the assessment of a patient clinical information system (PatCIS), as well as an evaluation of use of Web-based clinical guidelines. Issues in designing, prototyping and iteratively refining evaluation components are discussed, along with description of a 'virtual' usability laboratory.
Schutte, Jamie L; McCue, Michael P; Parmanto, Bambang; McGonigle, John; Handen, Benjamin; Lewis, Allen; Pulantara, I Wayan; Saptono, Andi
2015-03-01
The Autism Diagnostic Observation Schedule (ADOS) Module 4 is an autism assessment designed for verbally fluent adolescents and adults. Because of a shortage of available clinical expertise, it can be difficult for adults to receive a proper autism spectrum disorder (ASD) diagnostic assessment. A potential option to address this shortage is remote assessment. The objective of this study was to examine the feasibility, usability, and reliability of administering the ADOS Module 4 remotely using the Versatile and Integrated System for Telerehabilitation (VISYTER). VISYTER consists of computer stations at the client site and clinician site for video communication and a Web portal for managing and coordinating the assessment process. Twenty-three adults with an ASD diagnosis participated in a within-subject crossover design study in which both a remote ADOS and a face-to-face ADOS were administered. After completing the remote ADOS, participants completed a satisfaction survey. Participant satisfaction with the remote ADOS delivery system was high. The kappa value was greater than 0.61 on 21 of 31 ADOS items. There was substantial agreement on ADOS classification (i.e., diagnosis) between assessments delivered face-to-face versus assessments delivered remotely (interclass coefficient=0.92). Non-agreement may have been due to outside factors or practice effect despite a washout period. The results of this study demonstrate that an autism assessment designed to be delivered face to face can be administered remotely using an integrated Web-based system with high levels of usability and reliability.
NASA Astrophysics Data System (ADS)
McNamara, Laura A.; Berg, Leif; Butler, Karin; Klein, Laura
2017-05-01
Even as remote sensing technology has advanced in leaps and bounds over the past decade, the remote sensing community lacks interfaces and interaction models that facilitate effective human operation of our sensor platforms. Interfaces that make great sense to electrical engineers and flight test crews can be anxiety-inducing to operational users who lack professional experience in the design and testing of sophisticated remote sensing platforms. In this paper, we reflect on an 18-month collaboration which our Sandia National Laboratory research team partnered with an industry software team to identify and fix critical issues in a widely-used sensor interface. Drawing on basic principles from cognitive and perceptual psychology and interaction design, we provide simple, easily learned guidance for minimizing common barriers to system learnability, memorability, and user engagement.
Helping Hands: Using Augmented Reality to Provide Remote Guidance to Health Professionals.
Mather, Carey; Barnett, Tony; Broucek, Vlasti; Saunders, Annette; Grattidge, Darren; Huang, Weidong
2017-01-01
Access to expert practitioners or geographic distance can compound the capacity for appropriate supervision of health professionals in the workplace. Guidance and support of clinicians and students to undertake new or infrequent procedures can be resource intensive. The Helping Hands remote augmented reality system is an innovation to support the development of, and oversee the acquisition of procedural skills through remote learning and teaching supervision while in clinical practice. Helping Hands is a wearable, portable, hands-free, low cost system comprised of two networked laptops, a head-mounted display worn by the recipient and a display screen used remotely by the instructor. Hand hygiene was used as the test procedure as it is a foundation skill learned by all health profession students. The technology supports unmediated remote gesture guidance by augmenting the object with the Helping Hands of a health professional. A laboratory-based study and field trial tested usability and feasibility of the remote guidance system. The study found the Helping Hands system did not compromise learning outcomes. This innovation has the potential to transform remote learning and teaching supervision by enabling health professionals and students opportunities to develop and improve their procedural performance at the workplace.
NASA Technical Reports Server (NTRS)
Anderson, R. R.
1970-01-01
Progress on research designed to test the usability of multispectral, high altitude, remotely sensed data to analyze ecological and hydrological conditions in estuarine environments is presented. Emphasis was placed on data acquired by NASA aircraft over the Patuxent River Chesapeake Bay Test Site, No. 168. Missions were conducted over the Chesapeake Bay at a high altitude flight of 18,460 m and a low altitude flight of 3070. The principle objectives of the missions were: (1) to determine feasibility of identifying source and extent of water pollution problems in Baltimore Harbor, Chesapeake Bay and major tributaries utilizing high altitude, ERTS analogous remote sensing data; (2) to determine the feasibility of mapping species composition and general ecological condition of Chesapeake Bay wetlands, utilizing high altitude, ERTS analogous data; (3) to correlate ground spectral reflectance characteristics of wetland plant species with tonal characteristics on multispectral photography; (4) to determine usefulness of high altitude thermal imagery in delinating isotherms and current patterns in the Chesapeake Bay; and (5) to investigate automated data interpretive techniques which may be usable on high altitude, ERTS analogous data.
Handels, H; Busch, C; Encarnação, J; Hahn, C; Kühn, V; Miehe, J; Pöppl, S I; Rinast, E; Rossmanith, C; Seibert, F; Will, A
1997-03-01
The software system KAMEDIN (Kooperatives Arbeiten und MEdizinische Diagnostik auf Innovativen Netzen) is a multimedia telemedicine system for exchange, cooperative diagnostics, and remote analysis of digital medical image data. It provides components for visualisation, processing, and synchronised audio-visual discussion of medical images. Techniques of computer supported cooperative work (CSCW) synchronise user interactions during a teleconference. Visibility of both local and remote cursor on the conference workstations facilitates telepointing and reinforces the conference partner's telepresence. Audio communication during teleconferences is supported by an integrated audio component. Furthermore, brain tissue segmentation with artificial neural networks can be performed on an external supercomputer as a remote image analysis procedure. KAMEDIN is designed as a low cost CSCW tool for ISDN based telecommunication. However it can be used on any TCP/IP supporting network. In a field test, KAMEDIN was installed in 15 clinics and medical departments to validate the systems' usability. The telemedicine system KAMEDIN has been developed, tested, and evaluated within a research project sponsored by German Telekom.
Evaluation of Sensor Configurations for Robotic Surgical Instruments
Gómez-de-Gabriel, Jesús M.; Harwin, William
2015-01-01
Designing surgical instruments for robotic-assisted minimally-invasive surgery (RAMIS) is challenging due to constraints on the number and type of sensors imposed by considerations such as space or the need for sterilization. A new method for evaluating the usability of virtual teleoperated surgical instruments based on virtual sensors is presented. This method uses virtual prototyping of the surgical instrument with a dual physical interaction, which allows testing of different sensor configurations in a real environment. Moreover, the proposed approach has been applied to the evaluation of prototypes of a two-finger grasper for lump detection by remote pinching. In this example, the usability of a set of five different sensor configurations, with a different number of force sensors, is evaluated in terms of quantitative and qualitative measures in clinical experiments with 23 volunteers. As a result, the smallest number of force sensors needed in the surgical instrument that ensures the usability of the device can be determined. The details of the experimental setup are also included. PMID:26516863
Evaluation of Sensor Configurations for Robotic Surgical Instruments.
Gómez-de-Gabriel, Jesús M; Harwin, William
2015-10-27
Designing surgical instruments for robotic-assisted minimally-invasive surgery (RAMIS) is challenging due to constraints on the number and type of sensors imposed by considerations such as space or the need for sterilization. A new method for evaluating the usability of virtual teleoperated surgical instruments based on virtual sensors is presented. This method uses virtual prototyping of the surgical instrument with a dual physical interaction, which allows testing of different sensor configurations in a real environment. Moreover, the proposed approach has been applied to the evaluation of prototypes of a two-finger grasper for lump detection by remote pinching. In this example, the usability of a set of five different sensor configurations, with a different number of force sensors, is evaluated in terms of quantitative and qualitative measures in clinical experiments with 23 volunteers. As a result, the smallest number of force sensors needed in the surgical instrument that ensures the usability of the device can be determined. The details of the experimental setup are also included.
Calculating Irradiance For Photosynthesis In The Ocean
NASA Technical Reports Server (NTRS)
Collins, Donald J.; Davis, Curtiss O.; Booth, C. Rockwell; Kiefer, Dale A.; Stallings, Casson
1990-01-01
Mathematical model predicts available and usable irradiances. Yields estimates of irradiance available for photosynthesis (Epar) and irradiance usable for photosynthesis (Epur) as functions of depth in ocean. Describes Epur and Epar in terms of spectral parameters measured remotely (from satellites or airplanes). These irradiances useful in studies of photosynthetic productivity of phytoplankton in euphotic layer.
Conferences as Information Grounds: Web Site Evaluation with a Mobile Usability Laboratory
ERIC Educational Resources Information Center
Bossaller, Jenny S.; Paul, Anindita; Hill, Heather; Wang, Jiazhen; Erdelez, Sanda
2008-01-01
This article describes an "on-the-road" usability study and explains the study's methodological challenges, solutions, and recommendations. The study concerned a library-consortium website, which is a communication and educational tool for librarians who are physically dispersed throughout the state, and an intranet for remote users.…
Remote Attitude Measurement Sensor (RAMS)
NASA Technical Reports Server (NTRS)
Davis, H. W.
1989-01-01
Remote attitude measurement sensor (RAMS) offers a low-cost, low-risk, proven design concept that is based on mature, demonstrated space sensor technology. The electronic design concepts and interpolation algorithms were tested and proven in space hardware like th Retroreflector Field Tracker and various star trackers. The RAMS concept is versatile and has broad applicability to both ground testing and spacecraft needs. It is ideal for use as a precision laboratory sensor for structural dynamics testing. It requires very little set-up or preparation time and the output data is immediately usable without integration or extensive analysis efforts. For on-orbit use, RAMS rivals any other type of dynamic structural sensor (accelerometer, lidar, photogrammetric techniques, etc.) for overall performance, reliability, suitability, and cost. Widespread acceptance and extensive usage of RAMS will occur only after some interested agency, such as OAST, adopts the RAMS concept and provides the funding support necessary for further development and implementation of RAMS for a specific program.
Role of remote sensing in documenting living resources
NASA Technical Reports Server (NTRS)
Wagner, P. E.; Anderson, R. R.; Brun, B.; Eisenberg, M.; Genys, J. B.; Lear, D. W., Jr.; Miller, M. H.
1978-01-01
Specific cases of known or potentially useful applications of remote sensing in assessing biological resources are discussed. It is concluded that the more usable remote sensing techniques relate to the measurement of population fluctuations in aquatic systems. Sensing of the flora and the fauna of the Bay is considered with emphasis on direct sensing of aquatic plant populations and of water quality. Recommendations for remote sensing projects are given.
User-friendly cognitive training for the elderly: a technical report.
Boquete, Luciano; Rodríguez-Ascariz, José Manuel; Amo-Usanos, Carlos; Martínez-Arribas, Alejandro; Amo-Usanos, Javier; Otón, Salvador
2011-01-01
This article presents a system that implements a cognitive training program in users' homes. The system comprises various applications designed to create a daily brain-fitness regime. The proposed mental training system uses television and a remote control specially designed for the elderly. This system integrates Java applications to promote brain-fitness training in three areas: arithmetic, memory, and idea association. The system comprises the following: Standard television set, simplified wireless remote control, black box (system's core hardware and software), brain-fitness games (language Java), and Wi-Fi-enabled Internet-connected router. All data from the user training sessions are monitored through a control center. This control center analyzes the evolution of the user and the proper performance of the system during the test. The implemented system has been tested by six healthy volunteers. The results for this user group demonstrated the accessibility and usability of the system in a controlled real environment. The impressions of the users were very favorable, and they reported high adaptability to the system. The mean score for usability and accessibility assigned by the users was 3.56 out of 5 points. The operation stress test (over 200 h) was successful. The proposed system was used to implement a cognitive training program in users' homes, which was developed to be a low-cost tool with a high degree of user interactivity. The results of this preliminary study indicate that this user-friendly system could be adopted as a form of cognitive training for the elderly.
UNMANNED AERIAL VEHICLE (UAV) HYPERSPECTRAL REMOTE SENSING FOR DRYLAND VEGETATION MONITORING
DOE Office of Scientific and Technical Information (OSTI.GOV)
Nancy F. Glenn; Jessica J. Mitchell; Matthew O. Anderson
2012-06-01
UAV-based hyperspectral remote sensing capabilities developed by the Idaho National Lab and Idaho State University, Boise Center Aerospace Lab, were recently tested via demonstration flights that explored the influence of altitude on geometric error, image mosaicking, and dryland vegetation classification. The test flights successfully acquired usable flightline data capable of supporting classifiable composite images. Unsupervised classification results support vegetation management objectives that rely on mapping shrub cover and distribution patterns. Overall, supervised classifications performed poorly despite spectral separability in the image-derived endmember pixels. Future mapping efforts that leverage ground reference data, ultra-high spatial resolution photos and time series analysis shouldmore » be able to effectively distinguish native grasses such as Sandberg bluegrass (Poa secunda), from invasives such as burr buttercup (Ranunculus testiculatus) and cheatgrass (Bromus tectorum).« less
NASA Astrophysics Data System (ADS)
Hori, Masahiro; Kato, Takashi
While focusing on the human-computer interaction side of the Web content delivery, this article discusses problems and prospects of the mobile Web and Web accessibility in terms of what lessons and experiences we have gained from Web accessibility and what they can say about the mobile Web. One aim is to draw particular attention to the importance of explicitly distinguishing between perceptual and cognitive aspects of the users’ interactions with the Web. Another is to emphasize the increased importance of scenario-based evaluation and remote testing for the mobile Web where the limited screen space and a variety of environmental factors of mobile use are critical design issues. A newly devised inspection type of evaluation method that focuses on the perceptual-cognitive distinction of accessibility and usability issues is presented as a viable means of scenario-based, remote testing for the Web.
Designing and remotely testing mobile diabetes video games.
DeShazo, Jonathan; Harris, Lynne; Turner, Anne; Pratt, Wanda
2010-01-01
We have investigated game design and usability for three mobile phone video games designed to deliver diabetes education. The games were refined using focus groups. Six people with diabetes participated in the first focus group and five in the second. Following the focus groups, we incorporated the new findings into the game design, and then conducted a field test to evaluate the games in the context in which they would actually be used. Data were collected remotely about game usage by eight people with diabetes. The testers averaged 45 seconds per question and answered an average of 50 total nutrition questions each. They self-reported playing the game for 10-30 min, which coincided with the measured metrics of the game. Mobile games may represent a promising new way to engage the user and deliver relevant educational content.
Enhancing patient freedom in rehabilitation robotics using gaze-based intention detection.
Novak, Domen; Riener, Robert
2013-06-01
Several design strategies for rehabilitation robotics have aimed to improve patients' experiences using motivating and engaging virtual environments. This paper presents a new design strategy: enhancing patient freedom with a complex virtual environment that intelligently detects patients' intentions and supports the intended actions. A 'virtual kitchen' scenario has been developed in which many possible actions can be performed at any time, allowing patients to experiment and giving them more freedom. Remote eye tracking is used to detect the intended action and trigger appropriate support by a rehabilitation robot. This approach requires no additional equipment attached to the patient and has a calibration time of less than a minute. The system was tested on healthy subjects using the ARMin III arm rehabilitation robot. It was found to be technically feasible and usable by healthy subjects. However, the intention detection algorithm should be improved using better sensor fusion, and clinical tests with patients are needed to evaluate the system's usability and potential therapeutic benefits.
Evangelista, Lorraine S.; Moser, Debra K.; Lee, Jung-Ah; Moore, Alison A.; Ghasemzadeh, Hassan; Sarrafzadeh, Majid; Mangione, Carol M.
2015-01-01
Objective: This study was conducted to evaluate the feasibility, usability, and acceptability of using remote monitoring systems (RMS) in monitoring health status (e.g., vital signs, symptom distress) in older adults (≥55) with chronic heart failure (HF). Method: Twenty-one patients (52.4% women, mean age 73.1 ± 9.3) were trained to measure and transmit health data with an RMS. Data transmissions were tracked for 12 weeks. Results: All participants initiated use of RMS within 1 week; 71%, 14%, and 14% of patients transmitted daily health data 100%, ≥75%, and <75% of the time, respectively, for 12 weeks. Overall usability and acceptability of the RMS were 4.08 ± 0.634 and 4.10 ± 0.563, respectively (when scored on a range of 1-5, where 1 = strongly disagree and 5 = strongly agree). Discussion: Findings show that an RMS-based intervention can be successfully implemented in a group of older patients with chronic HF. PMID:28138479
Interactivity Centered Usability Evaluation (ICUE) for Course Management Systems
ERIC Educational Resources Information Center
Yoon, Sangil
2010-01-01
ICUE (Interactivity Centered Usability Evaluation) is an enhanced usability testing protocol created by the researcher. ICUE augments the facilitator's role for usability testing, and offers strategies in developing and presenting usability tasks during a testing session. ICUE was designed to address weaknesses found in the usability evaluation of…
A socialization intervention in remote health coaching for older adults in the home.
Jimison, Holly B; Klein, Krystal A; Marcoe, Jennifer L
2013-01-01
Previous studies have shown that social ties enhance both physical and mental health, and that social isolation has been linked to increased cognitive decline. As part of our cognitive training platform, we created a socialization intervention to address these issues. The intervention is designed to improve social contact time of older adults with remote family members and friends using a variety of technologies, including Web cameras, Skype software, email and phone. We used usability testing, surveys, interviews and system usage monitoring to develop design guidance for socialization protocols that were appropriate for older adults living independently in their homes. Our early results with this intervention show increased number of social contacts, total communication time (we measure email, phone, and Skype usage) and significant participant satisfaction with the intervention.
A Socialization Intervention in Remote Health Coaching for Older Adults in the Home*
Jimison, Holly B.; Klein, Krystal A.; Marcoe, Jennifer L.
2014-01-01
Previous studies have shown that social ties enhance both physical and mental health, and that social isolation has been linked to increased cognitive decline. As part of our cognitive training platform, we created a socialization intervention to address these issues. The intervention is designed to improve social contact time of older adults with remote family members and friends using a variety of technologies, including Web cameras, Skype software, email and phone. We used usability testing, surveys, interviews and system usage monitoring to develop design guidance for socialization protocols that were appropriate for older adults living independently in their homes. Our early results with this intervention show increased number of social contacts, total communication time (we measure email, phone, and Skype usage) and significant participant satisfaction with the intervention. PMID:24111362
Rodriguez-Valero, N; Carbayo, M J Ledesma; Sanchez, D Cuadrado; Vladimirov, A; Espriu, M; Vera, I; Roldan, M; de Alba, T; Sanz, S; Moreno, J L Gonzalez; Oroz, M Luengo; Muñoz, J
2018-01-01
Trip Doctor®, a Smartphone-based app monitoring system, was developed to detect infections among travelers in real-time. For testing, 106 participants were recruited (62.2% male, mean age 36 years (SD = 11)). Majority of trips were for tourism and main destinations were in South East Asia. Mean travel duration was 14 days (SD = 10). Diarrhea was the most frequently reported symptom (15.5%). The system demonstrated adequate usability and is ready to be used on a larger scale.
The Feasibility and Usability of RunningCoach: A Remote Coaching System for Long-Distance Runners †
Bajcsy, Ruzena
2018-01-01
Studies have shown that about half of the injuries sustained during long-distance running involve the knee. Cadence (steps per minute) has been identified as a factor that is strongly associated with these running-related injuries, making it a worthwhile candidate for further study. As such, it is critical for long-distance runners to minimize their risk of injury by running at an appropriate running cadence. In this paper, we present the results of a study on the feasibility and usability of RunningCoach, a mobile health (mHealth) system that remotely monitors running cadence levels of runners in a continuous fashion, among other variables, and provides immediate feedback to runners in an effort to help them optimize their running cadence. PMID:29320436
A Terminal Area Icing Remote Sensing System
NASA Technical Reports Server (NTRS)
Reehorst, Andrew L.; Serke, David J.
2014-01-01
NASA and the National Center for Atmospheric Research (NCAR) have developed an icing remote sensing technology that has demonstrated skill at detecting and classifying icing hazards in a vertical column above an instrumented ground station. This technology is now being extended to provide volumetric coverage surrounding an airport. With volumetric airport terminal area coverage, the resulting icing hazard information will be usable by aircrews, traffic control, and airline dispatch to make strategic and tactical decisions regarding routing when conditions are conducive to airframe icing. Building on the existing vertical pointing system, the new method for providing volumetric coverage will utilize cloud radar, microwave radiometry, and NEXRAD radar. This terminal area icing remote sensing system will use the data streams from these instruments to provide icing hazard classification along the defined approach paths into an airport. Strategies for comparison to in-situ instruments on aircraft and weather balloons for a planned NASA field test are discussed, as are possible future applications into the NextGen airspace system.
Russ, Alissa L; Saleem, Jason J
2018-02-01
The quality of usability testing is highly dependent upon the associated usability scenarios. To promote usability testing as part of electronic health record (EHR) certification, the Office of the National Coordinator (ONC) for Health Information Technology requires that vendors test specific capabilities of EHRs with clinical end-users and report their usability testing process - including the test scenarios used - along with the results. The ONC outlines basic expectations for usability testing, but there is little guidance in usability texts or scientific literature on how to develop usability scenarios for healthcare applications. The objective of this article is to outline key factors to consider when developing usability scenarios and tasks to evaluate computer-interface based health information technologies. To achieve this goal, we draw upon a decade of our experience conducting usability tests with a variety of healthcare applications and a wide range of end-users, to include healthcare professionals as well as patients. We discuss 10 key factors that influence scenario development: objectives of usability testing; roles of end-user(s); target performance goals; evaluation time constraints; clinical focus; fidelity; scenario-related bias and confounders; embedded probes; minimize risks to end-users; and healthcare related outcome measures. For each factor, we present an illustrative example. This article is intended to aid usability researchers and practitioners in their efforts to advance health information technologies. The article provides broad guidance on usability scenario development and can be applied to a wide range of clinical information systems and applications. Published by Elsevier Inc.
Sawai, Takashi; Uzuki, Miwa; Miura, Yasuhiro; Kamataki, Akihisa; Matsumura, Tsubasa; Saito, Kenji; Kurose, Akira; Osamura, Yoshiyuki R.; Yoshimi, Naoki; Kanno, Hiroyuki; Moriya, Takuya; Ishida, Yoji; Satoh, Yohichi; Nakao, Masahiro; Ogawa, Emiko; Matsuo, Satoshi; Kasai, Hiroyuki; Kumagai, Kazuhiro; Motoda, Toshihiro; Hopson, Nathan
2013-01-01
Background: Recent advances in information technology have allowed the development of a telepathology system involving high-speed transfer of high-volume histological figures via fiber optic landlines. However, at present there are geographical limits to landlines. The Japan Aerospace Exploration Agency (JAXA) has developed the “Kizuna” ultra-high speed internet satellite and has pursued its various applications. In this study we experimented with telepathology in collaboration with JAXA using Kizuna. To measure the functionality of the Wideband InterNet working engineering test and Demonstration Satellite (WINDS) ultra-high speed internet satellite in remote pathological diagnosis and consultation, we examined the adequate data transfer speed and stability to conduct telepathology (both diagnosis and conferencing) with functionality, and ease similar or equal to telepathology using fiber-optic landlines. Materials and Methods: We performed experiments for 2 years. In year 1, we tested the usability of the WINDS for telepathology with real-time video and virtual slide systems. These are state-of-the-art technologies requiring massive volumes of data transfer. In year 2, we tested the usability of the WINDS for three-way teleconferencing with virtual slides. Facilities in Iwate (northern Japan), Tokyo, and Okinawa were connected via the WINDS and voice conferenced while remotely examining and manipulating virtual slides. Results: Network function parameters measured using ping and Iperf were within acceptable limits. However; stage movement, zoom, and conversation suffered a lag of approximately 0.8 s when using real-time video, and a delay of 60-90 s was experienced when accessing the first virtual slide in a session. No significant lag or inconvenience was experienced during diagnosis and conferencing, and the results were satisfactory. Our hypothesis was confirmed for both remote diagnosis using real-time video and virtual slide systems, and also for teleconferencing using virtual slide systems with voice functionality. Conclusions: Our results demonstrate the feasibility of ultra-high-speed internet satellite networks for use in telepathology. Because communications satellites have less geographical and infrastructural requirements than landlines, ultra-high-speed internet satellite telepathology represents a major step toward alleviating regional disparity in the quality of medical care. PMID:24244882
Usability of calcium carbide gas pressure method in hydrological sciences
NASA Astrophysics Data System (ADS)
Arsoy, S.; Ozgur, M.; Keskin, E.; Yilmaz, C.
2013-10-01
Soil moisture is a key engineering variable with major influence on ecological and hydrological processes as well as in climate, weather, agricultural, civil and geotechnical applications. Methods for quantification of the soil moisture are classified into three main groups: (i) measurement with remote sensing, (ii) estimation via (soil water balance) simulation models, and (iii) measurement in the field (ground based). Remote sensing and simulation modeling require rapid ground truthing with one of the ground based methods. Calcium carbide gas pressure (CCGP) method is a rapid measurement procedure for obtaining soil moisture and relies on the chemical reaction of the calcium carbide reagent with the water in soil pores. However, the method is overlooked in hydrological science applications. Therefore, the purpose of this study is to evaluate the usability of the CCGP method in comparison with standard oven-drying and dielectric methods in terms of accuracy, time efficiency, operational ease, cost effectiveness and safety for quantification of the soil moisture over a wide range of soil types. The research involved over 250 tests that were carried out on 15 different soil types. It was found that the accuracy of the method is mostly within ±1% of soil moisture deviation range in comparison to oven-drying, and that CCGP method has significant advantages over dielectric methods in terms of accuracy, cost, operational ease and time efficiency for the purpose of ground truthing.
A Comparison of What Is Part of Usability Testing in Three Countries
NASA Astrophysics Data System (ADS)
Clemmensen, Torkil
The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client's needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.
Integration of MSFC Usability Lab with Usability Testing
NASA Technical Reports Server (NTRS)
Cheng, Yiwei; Richardson, Sally
2010-01-01
As part of the Stage Analysis Branch, human factors engineering plays an important role in relating humans to the systems of hardware and structure designs of the new launch vehicle. While many branches are involved in the technical aspects of creating a launch vehicle, human factors connects humans to the scientific systems with the goal of improving operational performance and safety while reducing operational error and damage to the hardware. Human factors engineers use physical and computerized models to visualize possible areas for improvements to ensure human accessibility to components requiring maintenance and that the necessary maintenance activities can be accomplished with minimal risks to human and hardware. Many methods of testing are used to fulfill this goal, such as physical mockups, computerized visualization, and usability testing. In this analysis, a usability test is conducted to test how usable a website is to users who are and are not familiar with it. The testing is performed using participants and Morae software to record and analyze the results. This analysis will be a preliminary test of the usability lab in preparation for use in new spacecraft programs, NASA Enterprise, or other NASA websites. The usability lab project is divided into two parts: integration of the usability lab and a preliminary test of the usability lab.
Application-level regression testing framework using Jenkins
Budiardja, Reuben; Bouvet, Timothy; Arnold, Galen
2017-09-26
Monitoring and testing for regression of large-scale systems such as the NCSA's Blue Waters supercomputer are challenging tasks. In this paper, we describe the solution we came up with to perform those tasks. The goal was to find an automated solution for running user-level regression tests to evaluate system usability and performance. Jenkins, an automation server software, was chosen for its versatility, large user base, and multitude of plugins including collecting data and plotting test results over time. We also describe our Jenkins deployment to launch and monitor jobs on remote HPC system, perform authentication with one-time password, and integratemore » with our LDAP server for its authorization. We show some use cases and describe our best practices for successfully using Jenkins as a user-level system-wide regression testing and monitoring framework for large supercomputer systems.« less
Application-level regression testing framework using Jenkins
DOE Office of Scientific and Technical Information (OSTI.GOV)
Budiardja, Reuben; Bouvet, Timothy; Arnold, Galen
Monitoring and testing for regression of large-scale systems such as the NCSA's Blue Waters supercomputer are challenging tasks. In this paper, we describe the solution we came up with to perform those tasks. The goal was to find an automated solution for running user-level regression tests to evaluate system usability and performance. Jenkins, an automation server software, was chosen for its versatility, large user base, and multitude of plugins including collecting data and plotting test results over time. We also describe our Jenkins deployment to launch and monitor jobs on remote HPC system, perform authentication with one-time password, and integratemore » with our LDAP server for its authorization. We show some use cases and describe our best practices for successfully using Jenkins as a user-level system-wide regression testing and monitoring framework for large supercomputer systems.« less
Metrics for Assessing the Reliability of a Telemedicine Remote Monitoring System
Fox, Mark; Papadopoulos, Amy; Crump, Cindy
2013-01-01
Abstract Objective: The goal of this study was to assess using new metrics the reliability of a real-time health monitoring system in homes of older adults. Materials and Methods: The “MobileCare Monitor” system was installed into the homes of nine older adults >75 years of age for a 2-week period. The system consisted of a wireless wristwatch-based monitoring system containing sensors for location, temperature, and impacts and a “panic” button that was connected through a mesh network to third-party wireless devices (blood pressure cuff, pulse oximeter, weight scale, and a survey-administering device). To assess system reliability, daily phone calls instructed participants to conduct system tests and reminded them to fill out surveys and daily diaries. Phone reports and participant diary entries were checked against data received at a secure server. Results: Reliability metrics assessed overall system reliability, data concurrence, study effectiveness, and system usability. Except for the pulse oximeter, system reliability metrics varied between 73% and 92%. Data concurrence for proximal and distal readings exceeded 88%. System usability following the pulse oximeter firmware update varied between 82% and 97%. An estimate of watch-wearing adherence within the home was quite high, about 80%, although given the inability to assess watch-wearing when a participant left the house, adherence likely exceeded the 10 h/day requested time. In total, 3,436 of 3,906 potential measurements were obtained, indicating a study effectiveness of 88%. Conclusions: The system was quite effective in providing accurate remote health data. The different system reliability measures identify important error sources in remote monitoring systems. PMID:23611640
Using Internet of Things (IoT) technology to study environmental processes
NASA Astrophysics Data System (ADS)
Martinez, Kirk; Hart, Jane; Black, Andrew; Blagg, Olivia
2016-04-01
The Internet of Things is a term which has emerged to describe the increase of Internet connectivity of everyday objects. While wireless sensor networks have developed highly energy efficient designs they need a step-change in their interoperability and usability to become essential tools in the study of our environment. We discuss the design, deployment and results from an IoT system installed on the Cairngorm Plateau, Scotland. This is a fragile remote environment, which provides an ideal location to test IoT techniques. We have investigated cryospheric, hydrologic and ecological processes, and we report our preliminary findings.
Borycki, E; Kushniruk, A; Nohr, C; Takeda, H; Kuwata, S; Carvalho, C; Bainbridge, M; Kannry, J
2013-01-01
Issues related to lack of system usability and potential safety hazards continue to be reported in the health information technology (HIT) literature. Usability engineering methods are increasingly used to ensure improved system usability and they are also beginning to be applied more widely for ensuring the safety of HIT applications. These methods are being used in the design and implementation of many HIT systems. In this paper we describe evidence-based approaches to applying usability engineering methods. A multi-phased approach to ensuring system usability and safety in healthcare is described. Usability inspection methods are first described including the development of evidence-based safety heuristics for HIT. Laboratory-based usability testing is then conducted under artificial conditions to test if a system has any base level usability problems that need to be corrected. Usability problems that are detected are corrected and then a new phase is initiated where the system is tested under more realistic conditions using clinical simulations. This phase may involve testing the system with simulated patients. Finally, an additional phase may be conducted, involving a naturalistic study of system use under real-world clinical conditions. The methods described have been employed in the analysis of the usability and safety of a wide range of HIT applications, including electronic health record systems, decision support systems and consumer health applications. It has been found that at least usability inspection and usability testing should be applied prior to the widespread release of HIT. However, wherever possible, additional layers of testing involving clinical simulations and a naturalistic evaluation will likely detect usability and safety issues that may not otherwise be detected prior to widespread system release. The framework presented in the paper can be applied in order to develop more usable and safer HIT, based on multiple layers of evidence.
Using a fuzzy comprehensive evaluation method to determine product usability: A test case
Zhou, Ronggang; Chan, Alan H. S.
2016-01-01
BACKGROUND: In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. OBJECTIVE AND METHODS: In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. RESULTS AND CONCLUSIONS: This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method. PMID:28035942
Using a fuzzy comprehensive evaluation method to determine product usability: A test case.
Zhou, Ronggang; Chan, Alan H S
2017-01-01
In order to take into account the inherent uncertainties during product usability evaluation, Zhou and Chan [1] proposed a comprehensive method of usability evaluation for products by combining the analytic hierarchy process (AHP) and fuzzy evaluation methods for synthesizing performance data and subjective response data. This method was designed to provide an integrated framework combining the inevitable vague judgments from the multiple stages of the product evaluation process. In order to illustrate the effectiveness of the model, this study used a summative usability test case to assess the application and strength of the general fuzzy usability framework. To test the proposed fuzzy usability evaluation framework [1], a standard summative usability test was conducted to benchmark the overall usability of a specific network management software. Based on the test data, the fuzzy method was applied to incorporate both the usability scores and uncertainties involved in the multiple components of the evaluation. Then, with Monte Carlo simulation procedures, confidence intervals were used to compare the reliabilities among the fuzzy approach and two typical conventional methods combining metrics based on percentages. This case study showed that the fuzzy evaluation technique can be applied successfully for combining summative usability testing data to achieve an overall usability quality for the network software evaluated. Greater differences of confidence interval widths between the method of averaging equally percentage and weighted evaluation method, including the method of weighted percentage averages, verified the strength of the fuzzy method.
Ultra low-cost, portable smartphone optosensors for mobile point-of-care diagnostics
NASA Astrophysics Data System (ADS)
Wang, Li-Ju; Chang, Yu-Chung; Sun, Rongrong; Li, Lei
2018-02-01
Smartphone optosensors with integrated optical components make mobile point-of-care (MPoC) diagnostics be done near patients' side. It'll especially have a significant impact on healthcare delivery in rural or remote areas. Current FDA-approved PoC devices achieving clinical level are still at high cost and not affordable in rural hospitals. We present a series of ultra low-cost smartphone optical sensing devices for mobile point-of-care diagnosis. Aiming different targeting analytes and sensing mechanisms, we developed custom required optical components for each smartphone optosensros. These optical devices include spectrum readers, colorimetric readers for microplate, lateral flow device readers, and chemiluminescence readers. By integrating our unique designed optical components into smartphone optosening platform, the anlaytes can be precisely detected. Clinical testing results show the clinical usability of our smartphone optosensors. Ultra low-cost portable smartphone optosensors are affordable for rural/remote doctors.
A proactive system for maritime environment monitoring.
Moroni, Davide; Pieri, Gabriele; Tampucci, Marco; Salvetti, Ovidio
2016-01-30
The ability to remotely detect and monitor oil spills is becoming increasingly important due to the high demand of oil-based products. Indeed, shipping routes are becoming very crowded and the likelihood of oil slick occurrence is increasing. In this frame, a fully integrated remote sensing system can be a valuable monitoring tool. We propose an integrated and interoperable system able to monitor ship traffic and marine operators, using sensing capabilities from a variety of electronic sensors, along with geo-positioning tools, and through a communication infrastructure. Our system is capable of transferring heterogeneous data, freely and seamlessly, between different elements of the information system (and their users) in a consistent and usable form. The system also integrates a collection of decision support services providing proactive functionalities. Such services demonstrate the potentiality of the system in facilitating dynamic links among different data, models and actors, as indicated by the performed field tests. Copyright © 2015 Elsevier Ltd. All rights reserved.
Evaluation of the Next-Gen Exercise Software Interface in the NEEMO Analog
NASA Technical Reports Server (NTRS)
Hanson, Andrea; Kalogera, Kent; Sandor, Aniko; Hardy, Marc; Frank, Andrew; English, Kirk; Williams, Thomas; Perera, Jeevan; Amonette, William
2017-01-01
NSBRI (National Space Biomedical Research Institute) funded research grant to develop the 'NextGen' exercise software for the NEEMO (NASA Extreme Environment Mission Operations) analog. Develop a software architecture to integrate instructional, motivational and socialization techniques into a common portal to enhance exercise countermeasures in remote environments. Increase user efficiency and satisfaction, and institute commonality across multiple exercise systems. Utilized GUI (Graphical User Interface) design principals focused on intuitive ease of use to minimize training time and realize early user efficiency. Project requirement to test the software in an analog environment. Top Level Project Aims: 1) Improve the usability of crew interface software to exercise CMS (Crew Management System) through common app-like interfaces. 2) Introduce virtual instructional motion training. 3) Use virtual environment to provide remote socialization with family and friends, improve exercise technique, adherence, motivation and ultimately performance outcomes.
Evans, Jarrett; Papadopoulos, Amy; Silvers, Christine Tsien; Charness, Neil; Boot, Walter R; Schlachta-Fairchild, Loretta; Crump, Cindy; Martinez, Michele; Ent, Carrie Beth
2016-06-01
Remote health monitoring technology has been suggested as part of an early intervention and prevention care model. Older adults with a chronic health condition have been shown to benefit from remote monitoring but often have challenges with complex technology. The current study reports on the usability of and adherence with an integrated, real-time monitoring system over an extended period of time by older adults with and without a chronic health condition. Older adults 55 years of age and over with and without heart failure participated in a study in which a telehealth system was used for 6 months each. The system consisted of a wireless wristwatch-based monitoring device that continuously collected temperature and motion data. Other health information was collected daily using a weight scale, blood pressure cuff, and tablet that participants used for health surveys. Data were automatically analyzed and summarized by the system and presented to study nurses. Forty-one older adults participated. Seventy-one percent of surveys, 75% of blood pressure readings, and 81% of daily weight measurements were taken. Participants wore the watch monitor 77% of the overall 24/7 time requested. The weight scale had the highest usability rating in both groups. The groups did not otherwise differ on device usage. The findings indicate that a health monitoring system designed for older adults can and will be used for an extended period of time and may help older adults with chronic conditions reside longer in their own homes in partnership with the healthcare system.
2012-01-01
Background Management of cancer treatment-related symptoms is an important safety issue given that symptoms can become life-threatening and often occur when patients are at home. With funding from the Canadian Partnership Against Cancer, a pan-Canadian steering committee was established with representation from eight provinces to develop symptom protocols using a rigorous methodology (CAN-IMPLEMENT©). Each protocol is based on a systematic review of the literature to identify relevant clinical practice guidelines. Protocols were validated by cancer nurses from across Canada. The aim of this study is to build an effective and sustainable approach for implementing evidence-informed protocols for nurses to use when providing remote symptom assessment, triage, and guidance in self-management for patients experiencing symptoms while undergoing cancer treatments. Methods A prospective mixed-methods study design will be used. Guided by the Knowledge to Action Framework, the study will involve (a) establishing an advisory knowledge user team in each of three targeted settings; (b) assessing factors influencing nurses’ use of protocols using interviews/focus groups and a standardized survey instrument; (c) adapting protocols for local use, ensuring fidelity of the content; (d) selecting intervention strategies to overcome known barriers and implementing the protocols; (e) conducting think-aloud usability testing; (f) evaluating protocol use and outcomes by conducting an audit of 100 randomly selected charts at each of the three settings; and (g) assessing satisfaction with remote support using symptom protocols and change in nurses’ barriers to use using survey instruments. The primary outcome is sustained use of the protocols, defined as use in 75% of the calls. Descriptive analysis will be conducted for the barriers, use of protocols, and chart audit outcomes. Content analysis will be conducted on interviews/focus groups and usability testing with comparisons across settings. Discussion Given the importance of patient safety, patient-centered care, and delivery of quality services, learning how to effectively implement evidence-informed symptom protocols in oncology healthcare services is essential for ensuring safe, consistent, and effective care for individuals with cancer. This study is likely to have a significant contribution to the delivery of remote oncology services, as well as influence symptom management by patients at home. PMID:23164244
Why Citizen Science Without Usability Testing Will Underperform
NASA Astrophysics Data System (ADS)
Romano, C.; Gay, P.; Owens, R.; Burlea, G.
2017-12-01
Citizen science projects must undergo usability testing and optimization if they are to meet their stated goals. This presentation will include video of usability tests conducted upon citizen science websites. Usability testing is essential to the success of online interaction, however, citizen science projects have just begun to include this critical activity. Interaction standards in citizen science lag behind those of commercial interests, and published research on this topic is limited. Since online citizen science is by definition, an exchange of information, a clear understanding of how users experience an online project is essential to informed decision-making. Usability testing provides that insight. Usability testing collects data via direct observation of a person while she interacts with a digital product, such as a citizen science website. The test participant verbalizes her thoughts while using the website or application; the moderator follows the participant and captures quantitative measurement of the participant's confidence of success as she advances through the citizen science project. Over 15 years of usability testing, we have observed that users who do not report a consistent sense of progress are likely to abandon a website after as few as three unrewarding interactions. Since citizen science is also a voluntary activity, ensuring seamless interaction for users is mandatory. Usability studies conducted on citizen science websites demonstrate that project teams frequently underestimate a user's need for context and ease of use. Without usability testing, risks to online citizen science projects include high bounce rate (users leave the website without taking any action), abandonment (of the website, tutorials, registration), misunderstanding instructions (causing disorientation and erroneous conclusions), and ultimately, underperforming projects.
Kushniruk, Andre; Senathirajah, Yalini; Borycki, Elizabeth
2017-01-01
The usability and safety of health information systems have become major issues in the design and implementation of useful healthcare IT. In this paper we describe a multi-phased multi-method approach to integrating usability engineering methods into system testing to ensure both usability and safety of healthcare IT upon widespread deployment. The approach involves usability testing followed by clinical simulation (conducted in-situ) and "near-live" recording of user interactions with systems. At key stages in this process, usability problems are identified and rectified forming a usability and technology-induced error "safety net" that catches different types of usability and safety problems prior to releasing systems widely in healthcare settings.
Playbook Data Analysis Tool: Collecting Interaction Data from Extremely Remote Users
NASA Technical Reports Server (NTRS)
Kanefsky, Bob; Zheng, Jimin; Deliz, Ivonne; Marquez, Jessica J.; Hillenius, Steven
2017-01-01
Typically, user tests for software tools are conducted in person. At NASA, the users may be located at the bottom of the ocean in a pressurized habitat, above the atmosphere in the International Space Station, or in an isolated capsule on a simulated asteroid mission. The Playbook Data Analysis Tool (P-DAT) is a human-computer interaction (HCI) evaluation tool that the NASA Ames HCI Group has developed to record user interactions with Playbook, the group's existing planning-and-execution software application. Once the remotely collected user interaction data makes its way back to Earth, researchers can use P-DAT for in-depth analysis. Since a critical component of the Playbook project is to understand how to develop more intuitive software tools for astronauts to plan in space, P-DAT helps guide us in the development of additional easy-to-use features for Playbook, informing the design of future crew autonomy tools.P-DAT has demonstrated the capability of discreetly capturing usability data in amanner that is transparent to Playbook’s end-users. In our experience, P-DAT data hasalready shown its utility, revealing potential usability patterns, helping diagnose softwarebugs, and identifying metrics and events that are pertinent to Playbook usage aswell as spaceflight operations. As we continue to develop this analysis tool, P-DATmay yet provide a method for long-duration, unobtrusive human performance collectionand evaluation for mission controllers back on Earth and researchers investigatingthe effects and mitigations related to future human spaceflight performance.
Training Teachers and Serving Students: Applying Usability Testing in Writing Programs
ERIC Educational Resources Information Center
McGovern, Heather
2007-01-01
Teachers often test course materials by using them in class. Usability testing provides an alternative: teachers receive student feedback and revise materials "before" teaching a class. Case studies based on interviews and observations with two teaching assistants who usability tested materials before teaching introductory technical writing…
Schaarup, Clara; Hejlesen, Ole Kristian
2016-01-01
Objective. The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods. Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results. The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0–2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion. The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013. PMID:27974888
Lilholt, Pernille Heyckendorff; Schaarup, Clara; Hejlesen, Ole Kristian
2016-01-01
Objective . The aim of the present study is to evaluate the usability of the telehealth system, coined Telekit, by using an iterative, mixed usability approach. Materials and Methods . Ten double experts participated in two heuristic evaluations (HE1, HE2), and 11 COPD patients attended two think-aloud tests. The double experts identified usability violations and classified them into Jakob Nielsen's heuristics. These violations were then translated into measurable values on a scale of 0 to 4 indicating degree of severity. In the think-aloud tests, COPD participants were invited to verbalise their thoughts. Results . The double experts identified 86 usability violations in HE1 and 101 usability violations in HE2. The majority of the violations were rated in the 0-2 range. The findings from the think-aloud tests resulted in 12 themes and associated examples regarding the usability of the Telekit system. The use of the iterative, mixed usability approach produced both quantitative and qualitative results. Conclusion . The iterative, mixed usability approach yields a strong result owing to the high number of problems identified in the tests because the double experts and the COPD participants focus on different aspects of Telekit's usability. This trial is registered with Clinicaltrials.gov, NCT01984840, November 14, 2013.
Alternate Hybrid Power Sources for Remote Site Applications.
1981-02-01
Fuel for remote LORAN-C sites is often acquired at higher costs in foreign spot markets . The effective fuel cost including the expense associated with...primary purpose of FPUP is to provide market support for manufacturers of solar cells and systems by encouraging federal agencies to utilize photo...supplied to them. 84 If 10,000 units were manufactured each year for the residential market with 10 kWh peak power and 25 kWh of usable energy stored in
A continuous usability evaluation of an electronic medication administration record application.
Vicente Oliveros, Noelia; Gramage Caro, Teresa; Pérez Menéndez-Conde, Covadonga; Álvarez-Diaz, Ana María; Martín-Aragón Álvarez, Sagrario; Bermejo Vicedo, Teresa; Delgado Silveira, Eva
2017-12-01
The complexity of an electronic medication administration record (eMAR) has been underestimated by most designers in the past. Usability issues, such as poorly designed user application flow in eMAR, are therefore of vital importance, since they can have a negative impact on nursing activities and result in poor outcomes. The purpose of this study was to evaluate the usability of an eMAR application during its development. A usability evaluation was conducted during the development of the eMAR application. Two usability methods were used: a heuristic evaluation complemented by usability testing. Each eMAR application version provided by the vendor was evaluated by 2 hospital pharmacists, who applied the heuristic method. They reviewed the eMAR tasks, detected usability problems and their heuristic violations, and rated the severity of the usability problems. Usability testing was used to assess the final application version by observing how 3 nurses interacted with the application. Thirty-four versions were assessed before the eMAR application was considered usable. During the heuristic evaluation, the usability problems decreased from 46 unique usability problems in version 1 (V1) to 9 in version 34 (V34). In V1, usability problems were categorized into 154 heuristic violations, which decreased to 27 in V34. The average severity rating also decreased from major usability problem (2.96) to no problem (0.23). During usability testing, the 3 nurses did not encounter new usability problems. A thorough heuristic evaluation is a good method for obtaining a usable eMAR application. This evaluation points key areas for improvement and decreases usability problems and their severity. © 2017 John Wiley & Sons, Ltd.
Earthdata Search Usability Study Process
NASA Technical Reports Server (NTRS)
Reese, Mark
2016-01-01
User experience (UX) design is the process of enhancing user satisfaction by improving various aspects of the user's interaction with an application or website. One aspect of UX design is usability, or the extent to which an application can be used to to accomplish tasks efficiently, effectively, and with satisfaction. NASA's Earthdata Search Client recently underwent a focused usability testing project to measure usability and gain valuable user feedback and insights to increase usability for its end-users. This presentation focuses on the process by which the usability tests were administered and the lessons learned throughout the process.
Designing Home-Based Telemedicine Systems for the Geriatric Population: An Empirical Study.
Narasimha, Shraddhaa; Agnisarman, Sruthy; Chalil Madathil, Kapil; Gramopadhye, Anand; McElligott, James T
2018-02-01
Background and Introduction: Telemedicine, the process of providing healthcare remotely using communication devices, has the potential to be useful for the geriatric population when specifically designed for this age group. This study explored the design of four video telemedicine systems currently available and outlined issues with these systems that impact usability among the geriatric population. Based on the results, design suggestions were developed to improve telemedicine systems for this population. Using a between-subjects experimental design, the study considered four telemedicine systems used in Medical University of South Carolina. The study was conducted at a local retirement home. The participant pool consisted of 40 adults, 60 years or older. The dependent measures used were the mean times for telemedicine session initiation and video session, mean number of errors, post-test satisfaction ratings, the NASA-Task Load Index (NASA-TLX) workload measures, and the IBM-Computer Systems Usability Questionnaire measures. Statistical significance was found among the telemedicine systems' initiation times. The analysis of the qualitative data revealed several issues, including lengthy e-mail content, icon placement, and chat box design, which affect the usability of these systems for the geriatric population. Human factor-based design modifications, including short, precise e-mail content, appropriately placed icons, and the inclusion of instructions, are recommended to address the issues found in the qualitative study.
Applying usability testing techniques to improve a health promotion website.
Hinchliffe, Anetta; Mummery, W Kerry
2008-04-01
Use of the Internet for health promotion is increasing; however, the lack of published research regarding website usability suggests that health promotion websites are being developed without consultation with their users or formal evaluation. This study conducted usability testing of an existing health promotion website to inform modifications and to identify common usability themes that should be addressed by organisations developing or maintaining a health promotion website. A combination of qualitative and quantitative techniques were implemented during the usability testing sessions to gather data from users while completing tasks on the website. Techniques included performance measures (time taken), direct observation (participant observation) and subjective user preferences (questionnaire and interview). Improvements to the website were measured in terms of reduced problems reported, reduced time taken to complete tasks and increased subjective reports. Seven usability themes emerged from the data: design, feedback, format, instructions, navigation, terminology and learnability. This study demonstrates the application of usability testing to the design and modification of a health promotion website and illustrates the areas or themes that can be used as a framework for testing and modification.
Remote Usability Testing and Satisfaction with a Mobile Health Medication Inquiry System in CKD.
Diamantidis, Clarissa J; Ginsberg, Jennifer S; Yoffe, Marni; Lucas, Lisa; Prakash, Divya; Aggarwal, Saurabh; Fink, Wanda; Becker, Stefan; Fink, Jeffrey C
2015-08-07
Inappropriate medication use is common in the care of patients with CKD. The feasibility of a simple mobile health tool designed to advise patients on safe medication usage in CKD was examined. Participants with predialysis CKD (defined as eGFR<60 ml/min per 1.73 m(2)) in the Safe Kidney Care Cohort Study were recruited for home usability testing of a novel medication inquiry system between January and September of 2013. Testing was through two mobile platforms: (1) short messaging service text or (2) personal digital assistant (e.g., iPod Touch). Twenty participants (one half assigned to one device and one half assigned to the other device) were enrolled and received an in-center tutorial on device usage before the end of the study visit. Participants were subsequently mailed three sample pill bottles with the name of randomly selected medications and asked to input these medications into the medication inquiry system. The medication inquiry system response options were as follows: (1) safe in CKD, (2) not safe in CKD, (3) use with caution/speak with your health care provider, or (4) error message (for an incorrectly inputted medication). Participants were asked to record the response issued by the medication inquiry system for each medication sent for usability testing. A user satisfaction survey was administered after completion of the protocol. All participants owned a mobile telephone, but few owned a smartphone. Of 60 total medication queries, there were only three recorded errors, two of which occurred in the short messaging service texting group. Overall satisfaction with the application was high, with slightly higher satisfaction noted in the personal digital assistant group compared with the short messaging service group. The mobile health medication inquiry system application had general ease of use and high acceptance across two platforms among individuals representative of the CKD population. Tailored mobile health technology may improve medication safety in CKD. Copyright © 2015 by the American Society of Nephrology.
Lobach, David F; Johns, Ellis B; Halpenny, Barbara; Saunders, Toni-Ann; Brzozowski, Jane; Del Fiol, Guilherme; Berry, Donna L; Braun, Ilana M; Finn, Kathleen; Wolfe, Joanne; Abrahm, Janet L; Cooley, Mary E
2016-11-08
Management of uncontrolled symptoms is an important component of quality cancer care. Clinical guidelines are available for optimal symptom management, but are not often integrated into the front lines of care. The use of clinical decision support (CDS) at the point-of-care is an innovative way to incorporate guideline-based symptom management into routine cancer care. The objective of this study was to develop and evaluate a rule-based CDS system to enable management of multiple symptoms in lung cancer patients at the point-of-care. This study was conducted in three phases involving a formative evaluation, a system evaluation, and a contextual evaluation of clinical use. In Phase 1, we conducted iterative usability testing of user interface prototypes with patients and health care providers (HCPs) in two thoracic oncology clinics. In Phase 2, we programmed complex algorithms derived from clinical practice guidelines into a rules engine that used Web services to communicate with the end-user application. Unit testing of algorithms was conducted using a stack-traversal tree-spanning methodology to identify all possible permutations of pathways through each algorithm, to validate accuracy. In Phase 3, we evaluated clinical use of the system among patients and HCPs in the two clinics via observations, structured interviews, and questionnaires. In Phase 1, 13 patients and 5 HCPs engaged in two rounds of formative testing, and suggested improvements leading to revisions until overall usability scores met a priori benchmarks. In Phase 2, symptom management algorithms contained between 29 and 1425 decision nodes, resulting in 19 to 3194 unique pathways per algorithm. Unit testing required 240 person-hours, and integration testing required 40 person-hours. In Phase 3, both patients and HCPs found the system usable and acceptable, and offered suggestions for improvements. A rule-based CDS system for complex symptom management was systematically developed and tested. The complexity of the algorithms required extensive development and innovative testing. The Web service-based approach allowed remote access to CDS knowledge, and could enable scaling and sharing of this knowledge to accelerate availability, and reduce duplication of effort. Patients and HCPs found the system to be usable and useful. ©David F Lobach, Ellis B Johns, Barbara Halpenny, Toni-Ann Saunders, Jane Brzozowski, Guilherme Del Fiol, Donna L Berry, Ilana M Braun, Kathleen Finn, Joanne Wolfe, Janet L Abrahm, Mary E Cooley. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 08.11.2016.
Brock, Douglas; Kim, Sara; Palmer, Odawni; Gallagher, Thomas; Holmboe, Eric
2013-01-01
Usability evaluation provides developers and educators with the means to understand user needs, improve overall product utility, and increase user satisfaction. The application of "discount usability" principles developed to make usability testing more practical and useful may improve user experience at minimal cost and require little existing expertise to conduct. We describe an application of discount usability to a high-fidelity online communications assessment application developed by the University of Washington for the American Board of Internal Medicine. Eight internal medicine physicians completed a discount usability test. Sessions were recorded and the videos analyzed for significant usability concerns. Concerns were identified, summarized, discussed, and prioritized by the authors in collaboration with the software developers before implementing any changes to the interface. Thirty-eight significant usability issues were detected and four technical problems were identified. Each issue was responded to through modification of the software, by providing additional instruction, or delayed for a later version to be developed. Discount usability can be easily implemented in academic developmental activities. Our study resulted in the discovery and remediation of significant user problems, in addition to giving important insight into the novel methods built into the application.
Applying heuristic evaluation to improve the usability of a telemedicine system.
Tang, Zhihua; Johnson, Todd R; Tindall, R Douglas; Zhang, Jiajie
2006-02-01
The development of a telemedicine system should not only take advantage of technological advances but also pay close attention to users and the human issues involved. In this paper we examine the utility of heuristic evaluation in improving the usability of a digital emergency medical services (EMS) system equipped on an ambulance. The digital EMS system used advanced communication technologies to help remotely located trauma specialists gain access to patient data in real-time and direct life-saving measures in a timely fashion. To improve its usability, three experts inspected prototypes of the system according to 14 software usability heuristics. The analyses revealed information on the prevalence, severity, and nature of heuristic violations in the user interface design. The results were subsequently utilized to guide the iterative software design process. A comparison between two consecutive prototypes showed that the second design had only half as many usability violations as the first prototype and had considerable improvement in a number of usability heuristic categories. The validity of heuristic evaluation was examined in an ethnographic study of paramedics using a prototype of the system in their work environment. Users' task performances partially verified heuristic evaluation results. However, they also revealed problems that were not identified in heuristic evaluation but only became prominent during field observation. In conclusion, we argue that usability should be given high priority in the development of a telemedicine system, and that heuristic evaluation can be an effective and efficient way to identify usability problems in the early stage of software development.
Acceptability and usability of a telepresence robot for geriatric primary care: A pilot.
Vermeersch, Patricia; Sampsel, Debi D; Kleman, Carolyn
2015-01-01
The dual challenge of increasing numbers of older adults and overall increases in those with some form of insurance is driving the need to develop and evaluate novel methods of primary care delivery such as telehealth. The goal of this study was to explore the acceptability and usability of a remote presence robot (RPR) in a simulated primary care wellness encounter for older adults. A descriptive exploratory study was used to determine the acceptability and usability of the RPR operated by an APRN 250 miles from 13 older adults residing in a high rise during a simulated primary care visit. The results support previous research that technology such as the RPR can be both acceptable and useful for an older adult and primary care provider but only in certain circumstances. Copyright © 2015 Elsevier Inc. All rights reserved.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Warkentin, H; Bubric, K; Giovannetti, H
2016-06-15
Purpose: As a quality improvement measure, we undertook this work to incorporate usability testing into the implementation procedures for new electronic documents and forms used by four affiliated radiation therapy centers. Methods: A human factors specialist provided training in usability testing for a team of medical physicists, radiation therapists, and radiation oncologists from four radiotherapy centers. A usability testing plan was then developed that included controlled scenarios and standardized forms for qualitative and quantitative feedback from participants, including patients. Usability tests were performed by end users using the same hardware and viewing conditions that are found in the clinical environment.more » A pilot test of a form used during radiotherapy CT simulation was performed in a single department; feedback informed adaptive improvements to the electronic form, hardware requirements, resource accessibility and the usability testing plan. Following refinements to the testing plan, usability testing was performed at three affiliated cancer centers with different vault layouts and hardware. Results: Feedback from the testing resulted in the detection of 6 critical errors (omissions and inability to complete task without assistance), 6 non-critical errors (recoverable), and multiple suggestions for improvement. Usability problems with room layout were detected at one center and problems with hardware were detected at one center. Upon amalgamation and summary of the results, three key recommendations were presented to the document’s authors for incorporation into the electronic form. Documented inefficiencies and patient safety concerns related to the room layout and hardware were presented to administration along with a request for funding to purchase upgraded hardware and accessories to allow a more efficient workflow within the simulator vault. Conclusion: By including usability testing as part of the process when introducing any new document or procedure into clinical use, associated risks can be identified and mitigated before patient care and clinical workflow are impacted.« less
Teleophthalmology in Practice: Lessons Learned from a Pilot Project
Ayatollahi, Haleh; Nourani, Aynaz; Khodaveisi, Taleb; Aghaei, Hossein; Mohammadpour, Mehrdad
2017-01-01
Introduction: Ophthalmology is a medical specialty which may benefit from using telemedicine and teleophthalmology services. Such services are significantly important in the poor, remote, and impassable geographical areas, where there is no access to the ophthalmology services and ophthalmologists. This study aimed to design and implement a teleophthalmology system using the method of store-and-forward. Methods: The study was conducted in 2015 and consisted of two main phases. The first phase was based requirement analysis, and in the second phase, after designing the prototype, an initial usability testing was undertaken in a teaching hospital. The participants of the study were 10 optometrists and 10 ophthalmologists (cornea specialists). For each phase of the research, a questionnaire was used to collect data, and the collected data were analyzed using descriptive statistics. Results: In this study, users’ requirements were initially investigated. Then, the teleophthalmology system was designed based on the literature review and the results derived from the requirements’ analysis. Finally, usability testing showed that the users were relatively satisfied with the system. Conclusion: According to the results, it can be concluded that the teleophthalmology technology can be used in the country by optometrists and ophthalmologists to improve eye health care services and to prevent the prevalence of curable eye diseases. PMID:29081869
Georgsson, Mattias; Staggers, Nancy
2016-02-01
mHealth systems are becoming more common to aid patients in their diabetes self-management, but recent studies indicate a need for thorough evaluation of patients' experienced usability. Current evaluations lack a multi-method design for data collection and structured methods for data analyses. The purpose of this study was to provide a feasibility test of a multi-method approach for both data collection and data analyses for patients' experienced usability of a mHealth system for diabetes type 2 self-management. A random sample of 10 users was selected from a larger clinical trial. Data collection methods included user testing with eight representative tasks and Think Aloud protocol, a semi-structured interview and a questionnaire on patients' experiences using the system. The Framework Analysis (FA) method and Usability Problem Taxonomy (UPT) were used to structure, code and analyze the results. A usability severity rating was assigned after classification. The combined methods resulted in a total of 117 problems condensed into 19 usability issues with an average severity rating of 2.47 or serious. The usability test detected 50% of the initial usability problems, followed by the post-interview at 29%. The usability test found 18 of 19 consolidated usability problems while the questionnaire uncovered one unique issue. Patients experienced most usability problems (8) in the Glucose Readings View when performing complex tasks such as adding, deleting, and exporting glucose measurements. The severity ratings were the highest for the Glucose Diary View, Glucose Readings View, and Blood Pressure View with an average severity rating of 3 (serious). Most of the issues were classified under the artifact component of the UPT and primary categories of Visualness (7) and Manipulation (6). In the UPT task component, most issues were in the primary category Task-mapping (12). Multiple data collection methods yielded a more comprehensive set of usability issues. Usability testing uncovered the largest volume of usability issues, followed by interviewing and then the questionnaire. The interview did not surface any unique consolidated usability issues while the questionnaire surfaced one. The FA and UPT were valuable in structuring and classifying problems. The resulting descriptions serve as a communication tool in problem solving and programming. We recommend the usage of multiple methods in data collection and employing the FA and UPT in data analyses for future usability testing. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.
Ben Ramadan, Awatef Ahmed; Jackson-Thompson, Jeannette; Schmaltz, Chester Lee
2017-08-04
Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC's published InstantAtlas reports. An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants' comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants' spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC's published mapping reports. Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps' effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects' performance on the study test and the users' previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users' performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps' potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC's maps in the future. ©Awatef Ahmed Ben Ramadan, Jeannette Jackson-Thompson, Chester Lee Schmaltz. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 04.08.2017.
Jackson-Thompson, Jeannette; Schmaltz, Chester Lee
2017-01-01
Background Many users of spatial data have difficulty interpreting information in health-related spatial reports. The Missouri Cancer Registry and Research Center (MCR-ARC) has produced interactive reports for several years. These reports have never been tested for usability. Objective The aims of this study were to: (1) conduct a multi-approach usability testing study to understand ease of use (user friendliness) and user satisfaction; and (2) evaluate the usability of MCR-ARC’s published InstantAtlas reports. Methods An institutional review board (IRB) approved mixed methodology usability testing study using a convenience sample of health professionals. A recruiting email was sent to faculty in the Master of Public Health program and to faculty and staff in the Department of Health Management and Informatics at the University of Missouri-Columbia. The study included 7 participants. The test included a pretest questionnaire, a multi-task usability test, and the System Usability Scale (SUS). Also, the researchers collected participants’ comments about the tested maps immediately after every trial. Software was used to record the computer screen during the trial and the participants’ spoken comments. Several performance and usability metrics were measured to evaluate the usability of MCR-ARC’s published mapping reports. Results Of the 10 assigned tasks, 6 reached a 100% completion success rate, and this outcome was relative to the complexity of the tasks. The simple tasks were handled more efficiently than the complicated tasks. The SUS score ranged between 20-100 points, with an average of 62.7 points and a median of 50.5 points. The tested maps’ effectiveness outcomes were better than the efficiency and satisfaction outcomes. There was a statistically significant relationship between the subjects’ performance on the study test and the users’ previous experience with geographic information system (GIS) tools (P=.03). There were no statistically significant relationships between users’ performance and satisfaction and their education level, work type, or previous experience in health care (P>.05). There were strong positive correlations between the three measured usability elements. Conclusions The tested maps should undergo an extensive refining and updating to overcome all the discovered usability issues and meet the perspectives and needs of the tested maps’ potential users. The study results might convey the perspectives of academic health professionals toward GIS health data. We need to conduct a second-round usability study with public health practitioners and cancer professionals who use GIS tools on a routine basis. Usability testing should be conducted before and after releasing MCR-ARC’s maps in the future. PMID:28778842
The Usability of Online Geographic Virtual Reality for Urban Planning
NASA Astrophysics Data System (ADS)
Zhang, S.; Moore, A. B.
2013-08-01
Virtual reality (VR) technology is starting to become widely and freely available (for example the online OpenSimulator tool), with potential for use in 3D urban planning and design tasks but still needing rigorous assessment to establish this. A previous study consulted with a small group of urban professionals, who concluded in a satisfaction usability test that online VR had potential value as a usable 3D communication and remote marketing tool but acknowledged that visual quality and geographic accuracy were obstacles to overcome. This research takes the investigation a significant step further to also examine the usability aspects of efficiency (how quickly tasks are completed) and effectiveness (how successfully tasks are completed), relating to OpenSimulator in an urban planning situation. The comparative study pits a three-dimensional VR model (with increased graphic fidelity and geographic content to address the feedback of the previous study) of a subdivision design (in a Dunedin suburb) against 3D models built with GIS (ArcGIS) and CAD (BricsCAD) tools, two types of software environment well established in urban professional practice. Urban professionals participated in the study by attempting to perform timed tasks correctly in each of the environments before being asked questions about the technologies involved and their perceived importance to their professional work. The results reinforce the positive feedback for VR of the previous study, with the graphical and geographic data issues being somewhat addressed (though participants stressed the need for accurate and precise object and terrain modification capabilities in VR). Ease-ofuse and associated fastest task completion speed were significant positive outcomes to emerge from the comparison with GIS and CAD, pointing to a strong future for VR in an urban planning context.
Usability of a New Writing Assistive Device for Persons with Cervical Spinal Cord Injury.
Lim, MyungJoon; Park, Jiyoung; Lee, Kuem Ju; Kweon, Hyosun; Kim, Byungchul; Cho, Kyujin; Choi, Hyun
2015-01-01
The hand function for persons with cervical spinal cord injury (PCSCI) is most frequently cause difficulties in leading normal lives. The purpose of this study was to test the usability of a new writing assistive device (NWAD) for PCSCI. To access its usability, the authors design usability testing method and test the NWAD to five individuals with cervical spinal cord injury. From the usability testing, we have found number of issues that lead us to key design concept about developing the NWAD. The NWAD will be redesigned based on the result of the present study. We expect that the NWAD will help PCSCI use their affected hand better and improve the level of independence and quality of life.
New Options for Usability Testing Projects in Business Communication Courses
ERIC Educational Resources Information Center
Jameson, Daphne A.
2013-01-01
The increasing availability of recording technologies makes it easier to include usability testing projects in business communication courses. Usability testing is a method of discovering whether people can navigate, read, and understand a print or electronic communication well enough to achieve a particular purpose in a reasonable time frame.…
Collecting and Applying Usability Data from Distance Learners
ERIC Educational Resources Information Center
Mitchell, Emily; West, Brandon
2017-01-01
Growth of their college's off-campus and online course offerings led librarians at SUNY Oswego to run usability tests with off-campus students to compensate for a lack of responses from this population during earlier usability testing. Constraints on testing with off-campus students included lack of funding and librarian time, as well as…
Adding Users to the Website Design Process
ERIC Educational Resources Information Center
Tomeo, Megan L.
2012-01-01
Alden Library began redesigning its website over a year ago. Throughout the redesign process the students, faculty, and staff that make up the user base were added to the conversation by utilizing several usability test methods. This article focuses on the usability testing conducted at Alden Library and delves into future usability testing, which…
ERIC Educational Resources Information Center
Doubleday, Eldridge G.; O'Loughlin, Valerie D.; Doubleday, Alison F.
2011-01-01
An increasing number of instructors are seeking to provide students with online anatomy resources. Many researchers have attempted to identify associations between resource use and student learning but few studies discuss the importance of usability testing in resource design and modification. Usability testing provides information about ease of…
Kushniruk, Andre; Borycki, Elizabeth
2017-01-01
In recent years there has been considerable discussion around the need for certification and regulation of healthcare information technology (IT). In particular, the usability of the products being developed needs to be evaluated. This has included the application of standards designed to ensure the process of system development is user-centered and takes usability into consideration while a product is being developed. In addition to this, in healthcare, organizations in the United States and Europe have also addressed the need and requirement for product certification. However, despite these efforts there are continued reports of unusable and unsafe implementations. In this paper we discuss the need to not only include (and require) usability testing in the one-time development process of health IT products (such as EHRs), but we also argue for the need to additionally develop specific usability standards and requirements for usability testing during the implementation of vendor products (i.e. post product development) in healthcare settings. It is further argued that health IT products that may have been certified regarding their development process will still require application of usability testing in the process of implementing them in real hospital settings in order to ensure usability and safety. This is needed in order to ensure that the final result of both product development and implementation processes take into account and apply the latest usability principles and methods.
ERIC Educational Resources Information Center
Paladino, Emily B.; Klentzin, Jacqueline C.; Mills, Chloe P.
2017-01-01
Based on in-person, task-based usability testing and interviews, the authors' library Web site was recently overhauled in order to improve user experience. This led to the authors' interest in additional usability testing methods and test environments that would most closely fit their library's goals and situation. The appeal of card sorting…
Cortellessa, Gabriella; Fracasso, Francesca; Sorrentino, Alessandra; Orlandini, Andrea; Bernardi, Giulio; Coraci, Luca; De Benedictis, Riccardo; Cesta, Amedeo
2018-02-01
This article describes an enhanced telepresence robot named ROBIN, part of a telecare system derived from the GIRAFFPLUS project for supporting and monitoring older adults at home. ROBIN is integrated in a sensor-rich environment that aims to continuously monitor physical and psychological wellbeing of older persons living alone. The caregivers (formal/informal) can communicate through it with their assisted persons. Long-term trials in real houses highlighted several user requirements that inspired improvements on the robotic platform. The enhanced telepresence robot was assessed by users to test its suitability to support social interaction and provide motivational feedback on health-related aspects. Twenty-five users (n = 25) assessed the new multimodal interaction capabilities and new communication services. A psychophysiological approach was adopted to investigate aspects like engagement, usability, and affective impact, as well as the possible role of individual differences on the quality of human-robot interaction. ROBIN was overall judged usable, the interaction with/through it resulted pleasant and the required workload was limited, thus supporting the idea of using it as a central component for remote assistance and social participation. Open-minded users tended to have a more positive interaction with it. This work describes an enabling technology for remote assistance and social communication. It highlights the importance of being compliant with users' needs to develop solutions easy to use and able to foster their social connections. The role of personality appeared to be relevant for the interaction, underscoring a clear role of the service personalization.
User-Centered Design and Usability Testing of a Web Site: An Illustrative Case Study.
ERIC Educational Resources Information Center
Corry, Michael D.; Frick, Theodore W.; Hansen, Lisa
1997-01-01
Presents an overview of user-centered design and usability testing. Describes a Web site evaluation project at a university, the iterative process of rapid prototyping and usability testing, and how the findings helped to improve the design. Discusses recommendations for university Web site design and reflects on problems faced in usability…
Joe, Jonathan; Chaudhuri, Shomir; Le, Thai; Thompson, Hilaire; Demiris, George
2015-08-01
While health information technologies have become increasingly popular, many have not been formally tested to ascertain their usability. Traditional rigorous methods take significant amounts of time and manpower to evaluate the usability of a system. In this paper, we evaluate the use of instant data analysis (IDA) as developed by Kjeldskov et al. to perform usability testing on a tool designed for older adults and caregivers. The IDA method is attractive because it takes significantly less time and manpower than the traditional usability testing methods. In this paper we demonstrate how IDA was used to evaluate usability of a multifunctional wellness tool, discuss study results and lessons learned while using this method. We also present findings from an extension of the method which allows the grouping of similar usability problems in an efficient manner. We found that the IDA method is a quick, relatively easy approach to identifying and ranking usability issues among health information technologies. Copyright © 2015 Elsevier Inc. All rights reserved.
Lyles, Courtney R.; Sarkar, Urmimala; Osborn, Chandra Y.
2014-01-01
Consumer health technologies can educate patients about diabetes and support their self-management, yet usability evidence is rarely published even though it determines patient engagement, optimal benefit of any intervention, and an understanding of generalizability. Therefore, we conducted a narrative review of peer-reviewed articles published from 2009–2013 that tested the usability of a web- or mobile-delivered system/application designed to educate and support patients with diabetes. Overall, the 23 papers included in our review used mixed (n=11), descriptive quantitative (n=9), and qualitative methods (n=3) to assess usability, such as documenting which features performed as intended and how patients rated their experiences. More sophisticated usability evaluations combined several complementary approaches to elucidate more aspects of functionality. Future work pertaining to the design and evaluation of technology-delivered diabetes education/support interventions should aim to standardize the usability testing processes, and publish usability findings to inform interpretation of why an intervention succeeded or failed, and for whom. PMID:25173689
NASA Astrophysics Data System (ADS)
Dwi Susanto, Tony; Ingesti Prasetyo, Anisa; Astuti, Hanim Maria
2018-03-01
At this moment, the need for web as an information media is highly important. Not only confined in the infotainment area, government, and education, but health as well uses the web media as a medium for providing information effectively. BloobIS is a web based application which integrates blood supply and distribution information at the Blood Transfusion Unit. Knowing how easy information is on BloobIS is marked by how convenient the website is used. Up until now, the BloobIS website is nearing completion but testing has not yet been performed to users and is on the testing and development phase in the Development Life Cycle software. Thus, an evaluation namely the quality control software which focuses on the perspective of BloobIs web usability is required. Hallway Usability Testing and ISO 9241:11 are the methods chosen to measure the BloobIS application usability. The expected outputs of the quality control software focusing on the usability evaluation are being able to rectify the usability deficiencies on the BloobIs web and provide recommendations to develop the web as a basic BloobIS web quality upgraed which sets a goal to amplify the satisfaction of web users based on usability factors in ISO 9241:11.
Using a medical simulation center as an electronic health record usability laboratory
Landman, Adam B; Redden, Lisa; Neri, Pamela; Poole, Stephen; Horsky, Jan; Raja, Ali S; Pozner, Charles N; Schiff, Gordon; Poon, Eric G
2014-01-01
Usability testing is increasingly being recognized as a way to increase the usability and safety of health information technology (HIT). Medical simulation centers can serve as testing environments for HIT usability studies. We integrated the quality assurance version of our emergency department (ED) electronic health record (EHR) into our medical simulation center and piloted a clinical care scenario in which emergency medicine resident physicians evaluated a simulated ED patient and documented electronically using the ED EHR. Meticulous planning and close collaboration with expert simulation staff was important for designing test scenarios, pilot testing, and running the sessions. Similarly, working with information systems teams was important for integration of the EHR. Electronic tools are needed to facilitate entry of fictitious clinical results while the simulation scenario is unfolding. EHRs can be successfully integrated into existing simulation centers, which may provide realistic environments for usability testing, training, and evaluation of human–computer interactions. PMID:24249778
A systematic review of usability test metrics for mobile video streaming apps
NASA Astrophysics Data System (ADS)
Hussain, Azham; Mkpojiogu, Emmanuel O. C.
2016-08-01
This paper presents the results of a systematic review regarding the usability test metrics for mobile video streaming apps. In the study, 238 studies were found, but only 51 relevant papers were eventually selected for the review. The study reveals that time taken for video streaming and the video quality were the two most popular metrics used in the usability tests for mobile video streaming apps. Besides, most of the studies concentrated on the usability of mobile TV as users are switching from traditional TV to mobile TV.
Situated Usability Testing for Security Systems
DOE Office of Scientific and Technical Information (OSTI.GOV)
Greitzer, Frank L.
2011-03-02
While usability testing is well established, assessing the usability of security software, tools, or methods deserves more careful consideration. It has been argued that dealing with security has become too difficult for individuals or organizations to manage effectively or to use conveniently. As difficult as it is for system administrators and developers to deal with, security is even more challenging for casual users. Indeed, it is much too easy for casual/home users to configure the security of their systems in non-optimal ways that leave their systems inadvertently insecure. This is exacerbated by the fact that casual users are focused onmore » matters other than security, and likely would prefer not even to think about security. This brief report argues that when security and/or privacy are part of the equation, traditional methods for usability testing should be re-considered. The purpose of this brief report is to argue for and outline a method associated with a new approach to usability testing for examining usable security issues.« less
Optical Power Transfer System for Powering a Remote Mobility System for Multiple Missions
NASA Technical Reports Server (NTRS)
Hogan, Bartholomew P. (Inventor); Stone, William C. (Inventor)
2016-01-01
An optical power transfer system for powering a remote mobility system for multiple missions comprising a high power source and a chilling station connected to a laser source. The laser source transmits a high optical energy to a beam switch assembly via an optical fiber. The beam switch assembly is optically connected to actively cooled fiber spoolers. Docking stations are adapted for securing the fiber spoolers until alternatively ready for use by a remote mobility system. The remote mobility system is optically connected to the fiber spoolers and has a receiving port adapted for securing the fiber spoolers thereon. The fiber spooler transmits the optical energy to a power conversion system which converts the optical energy received to another usable form of energy. More than one power source may be used where the remote mobility system transfers from one source to another while maintaining an operational radius to each source.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Rankine, Leith J., E-mail: Leith_Rankine@med.unc.edu; Department of Radiation Oncology, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina; Mein, Stewart
Purpose: To validate the dosimetric accuracy of a commercially available magnetic resonance guided intensity modulated radiation therapy (MRgIMRT) system using a hybrid approach: 3-dimensional (3D) measurements and Monte Carlo calculations. Methods and Materials: We used PRESAGE radiochromic plastic dosimeters with remote optical computed tomography readout to perform 3D high-resolution measurements, following a novel remote dosimetry protocol. We followed the intensity modulated radiation therapy commissioning recommendations of American Association of Physicists in Medicine Task Group 119, adapted to incorporate 3D data. Preliminary tests (“AP” and “3D-Bands”) were delivered to 9.5-cm usable diameter cylindrical PRESAGE dosimeters to validate the treatment planning systemmore » (TPS) for nonmodulated deliveries; assess the sensitivity, uniformity, and rotational symmetry of the PRESAGE dosimeters; and test the robustness of the remote dosimetry protocol. Following this, 4 clinical MRgIMRT plans (“MultiTarget,” “Prostate,” “Head/Neck,” and “C-Shape”) were measured using 13-cm usable diameter PRESAGE dosimeters. For all plans, 3D-γ (3% or 3 mm global, 10% threshold) passing rates were calculated and 3D-γ maps were examined. Point doses were measured with an IBA-CC01 ionization chamber for validation of absolute dose. Finally, by use of an in-house-developed, GPU-accelerated Monte Carlo algorithm (gPENELOPE), we independently calculated dose for all 6 Task Group 119 plans and compared against the TPS. Results: For PRESAGE measurements, 3D-γ analysis yielded passing rates of 98.7%, 99.2%, 98.5%, 98.0%, 99.2%, and 90.7% for AP, 3D-Bands, MultiTarget, Prostate, Head/Neck, and C-Shape, respectively. Ion chamber measurements were within an average of 0.5% (±1.1%) from the TPS dose. Monte Carlo calculations demonstrated good agreement with the TPS, with a mean 3D-γ passing rate of 98.5% ± 1.9% using a stricter 2%/2-mm criterion. Conclusions: We have validated the dosimetric accuracy of a commercial MRgIMRT system using high-resolution 3D techniques. We have demonstrated for the first time that hybrid 3D remote dosimetry is a comprehensive and feasible approach to commissioning MRgIMRT. This may provide better sensitivity in error detection compared with standard 2-dimensional measurements and could be used when implementing complex new magnetic resonance guided radiation therapy technologies.« less
Design criteria for a PC-based common user interface to remote information systems
NASA Technical Reports Server (NTRS)
Dominick, Wayne D. (Editor); Hall, Philip P.
1984-01-01
A set of design criteria are presented which will allow the implementation of an interface to multiple remote information systems on a microcomputer. The focus of the design description is on providing the user with the functionality required to retrieve, store and manipulate data residing in remote information systems through the utilization of a standardized interface system. The intent is to spare the user from learning the details of retrieval from specific systems while retaining the full capabilities of each system. The system design includes multi-level capabilities to enhance usability by a wide range of users and utilizes microcomputer graphics capabilities where applicable. A data collection subsystem for evaluation purposes is also described.
ERIC Educational Resources Information Center
Bush, Jonathan, Ed.; Zuidema, Leah, Ed.
2012-01-01
In professional writing, usability testing investigates how well users can find, understand, and use a document (Lannon). Usability testing involves gathering feedback from users, analyzing how successfully they used the document, and drawing on the test results to change or refine the design. From the authors' experiences as writers and teachers,…
Usability Evaluation of Public Web Mapping Sites
NASA Astrophysics Data System (ADS)
Wang, C.
2014-04-01
Web mapping sites are interactive maps that are accessed via Webpages. With the rapid development of Internet and Geographic Information System (GIS) field, public web mapping sites are not foreign to people. Nowadays, people use these web mapping sites for various reasons, in that increasing maps and related map services of web mapping sites are freely available for end users. Thus, increased users of web mapping sites led to more usability studies. Usability Engineering (UE), for instance, is an approach for analyzing and improving the usability of websites through examining and evaluating an interface. In this research, UE method was employed to explore usability problems of four public web mapping sites, analyze the problems quantitatively and provide guidelines for future design based on the test results. Firstly, the development progress for usability studies were described, and simultaneously several usability evaluation methods such as Usability Engineering (UE), User-Centered Design (UCD) and Human-Computer Interaction (HCI) were generally introduced. Then the method and procedure of experiments for the usability test were presented in detail. In this usability evaluation experiment, four public web mapping sites (Google Maps, Bing maps, Mapquest, Yahoo Maps) were chosen as the testing websites. And 42 people, who having different GIS skills (test users or experts), gender (male or female), age and nationality, participated in this test to complete the several test tasks in different teams. The test comprised three parts: a pretest background information questionnaire, several test tasks for quantitative statistics and progress analysis, and a posttest questionnaire. The pretest and posttest questionnaires focused on gaining the verbal explanation of their actions qualitatively. And the design for test tasks targeted at gathering quantitative data for the errors and problems of the websites. Then, the results mainly from the test part were analyzed. The success rate from different public web mapping sites was calculated and compared, and displayed by the means of diagram. And the answers from questionnaires were also classified and organized in this part. Moreover, based on the analysis, this paper expands the discussion about the layout, map visualization, map tools, search logic and etc. Finally, this paper closed with some valuable guidelines and suggestions for the design of public web mapping sites. Also, limitations for this research stated in the end.
Kushniruk, Andre W; Borycki, Elizabeth M
2015-01-01
Usability has been identified as a key issue in health informatics. Worldwide numerous projects have been carried out in an attempt to increase and optimize health system usability. Usability testing, involving observing end users interacting with systems, has been widely applied and numerous publications have appeared describing such studies. However, to date, fewer works have been published describing methodological approaches to analyzing the rich data stream that results from usability testing. This includes analysis of video, audio and screen recordings. In this paper we describe our work in the development and application of a coding scheme for analyzing the usability of health information systems. The phases involved in such analyses are described.
"Think aloud" and "Near live" usability testing of two complex clinical decision support tools.
Richardson, Safiya; Mishuris, Rebecca; O'Connell, Alexander; Feldstein, David; Hess, Rachel; Smith, Paul; McCullagh, Lauren; McGinn, Thomas; Mann, Devin
2017-10-01
Low provider adoption continues to be a significant barrier to realizing the potential of clinical decision support. "Think Aloud" and "Near Live" usability testing were conducted on two clinical decision support tools. Each was composed of an alert, a clinical prediction rule which estimated risk of either group A Streptococcus pharyngitis or pneumonia and an automatic order set based on risk. The objective of this study was to further understanding of the facilitators of usability and to evaluate the types of additional information gained from proceeding to "Near Live" testing after completing "Think Aloud". This was a qualitative observational study conducted at a large academic health care system with 12 primary care providers. During "Think Aloud" testing, participants were provided with written clinical scenarios and asked to verbalize their thought process while interacting with the tool. During "Near Live" testing participants interacted with a mock patient. Morae usability software was used to record full screen capture and audio during every session. Participant comments were placed into coding categories and analyzed for generalizable themes. Themes were compared across usability methods. "Think Aloud" and "Near Live" usability testing generated similar themes under the coding categories visibility, workflow, content, understand-ability and navigation. However, they generated significantly different themes under the coding categories usability, practical usefulness and medical usefulness. During both types of testing participants found the tool easier to use when important text was distinct in its appearance, alerts were passive and appropriately timed, content was up to date, language was clear and simple, and each component of the tool included obvious indicators of next steps. Participant comments reflected higher expectations for usability and usefulness during "Near Live" testing. For example, visit aids, such as automatically generated order sets, were felt to be less useful during "Near-Live" testing because they would not be all inclusive for the visit. These complementary types of usability testing generated unique and generalizable insights. Feedback during "Think Aloud" testing primarily helped to improve the tools' ease of use. The additional feedback from "Near Live" testing, which mimics a real clinical encounter, was helpful for eliciting key barriers and facilitators to provider workflow and adoption. Copyright © 2017 Elsevier B.V. All rights reserved.
Kushniruk, Andre W; Borycki, Elizabeth M
2015-01-01
The development of more usable and effective healthcare information systems has become a critical issue. In the software industry methodologies such as agile and iterative development processes have emerged to lead to more effective and usable systems. These approaches highlight focusing on user needs and promoting iterative and flexible development practices. Evaluation and testing of iterative agile development cycles is considered an important part of the agile methodology and iterative processes for system design and re-design. However, the issue of how to effectively integrate usability testing methods into rapid and flexible agile design cycles has remained to be fully explored. In this paper we describe our application of an approach known as low-cost rapid usability testing as it has been applied within agile system development in healthcare. The advantages of the integrative approach are described, along with current methodological considerations.
Internationalization and localization: evaluating and testing a Website for Asian users.
Rau, Pei-Luen Patrick; Liang, Sheau-Farn Max
2003-01-15
The objective of this study was to combine internationalization and localization of Websites and improvement of Website usability with user-centred design methods. This study designed for internationalization and localization of Websites for Asian users, and implemented usability engineering into every phase of Website usability testing, based on the internationalization and localization perspectives of the honeywell.com/your home Website. The first step was to develop the usage scenarios. Three Asian usability specialists carried out one heuristic evaluation session for the current honeywell.com/your home Website. The usability problems were analysed and possible solutions to these problems were discussed. In the next phase, cluster analysis was utilized to test current information architecture. The results provided options for future information architecture development for this Website. Finally, a performance measurement test was conducted to investigate the performance for Asian users. Based on the results, suggestions for improving the Website usability from the localization perspective were provided. The results demonstrate the user-centred design (UCD) approach and stress international and local issues in Website development to Website designers.
The influence of socio-cultural background and product value in usability testing.
Sonderegger, Andreas; Sauer, Juergen
2013-05-01
This article examines the influence of socio-cultural background and product value on different outcomes of usability tests. A study was conducted in two different socio-cultural regions, Switzerland and East Germany, which differed in a number of aspects (e.g. economic power, price sensitivity and culture). Product value (high vs. low) was varied by manipulating the price of the product. Sixty-four test participants were asked to carry out five typical user tasks in the context of coffee machine usage, measuring performance, perceived usability, and emotion. The results showed that in Switzerland, high-value products were rated higher in usability than low-value products whereas in East Germany, high-value products were evaluated lower in usability. A similar interaction effect of socio-cultural background and product value was observed for user emotion. Implications are that the outcomes of usability tests do not allow for a simple transfer across cultures and that the mediating influence of perceived product value needs to be taken into consideration. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.
Technical Considerations in Remote LIMS Access via the World Wide Web
Schlabach, David M.
2005-01-01
The increased dependency on the World Wide Web by both laboratories and their customers has led LIMS developers to take advantage of thin-client web applications that provide both remote data entry and manipulation, along with remote reporting functionality. Use of an LIMS through a web browser allows a person to interact with a distant application, providing both remote administration and real-time analytical result delivery from virtually anywhere in the world. While there are many benefits of web-based LIMS applications, some concern must be given to these new methods of system architecture before justifying them as a suitable replacement for their traditional client-server systems. Developers and consumers alike must consider the security aspects of introducing a wide area network capable system into a production environment, as well as the concerns of data integrity and usability. PMID:18924736
Theodoros, Deborah G.; Russell, Trevor G.
2015-01-01
Background: Usability is an emerging domain of outcomes measurement in assistive technology provision. Currently, no questionnaires exist to test the usability of mobile shower commodes (MSCs) used by adults with spinal cord injury (SCI). Objective: To describe the development, construction, and initial content validation of an electronic questionnaire to test mobile shower commode usability for this population. Methods: The questionnaire was constructed using a mixed-methods approach in 5 phases: determining user preferences for the questionnaire’s format, developing an item bank of usability indicators from the literature and judgement of experts, constructing a preliminary questionnaire, assessing content validity with a panel of experts, and constructing the final questionnaire. Results: The electronic Mobile Shower Commode Assessment Tool Version 1.0 (eMAST 1.0) questionnaire tests MSC features and performance during activities identified using a mixed-methods approach and in consultation with users. It confirms that usability is complex and multidimensional. The final questionnaire contains 25 questions in 3 sections. The eMAST 1.0 demonstrates excellent content validity as determined by a small sample of expert clinicians. Conclusion: The eMAST 1.0 tests usability of MSCs from the perspective of adults with SCI and may be used to solicit feedback during MSC design, assessment, prescription, and ongoing use. Further studies assessing the eMAST’s psychometric properties, including studies with users of MSCs, are needed. PMID:25762862
Nijenhuis, Sharon M; Prange, Gerdienke B; Amirabdollahian, Farshid; Sale, Patrizio; Infarinato, Francesco; Nasr, Nasrin; Mountain, Gail; Hermens, Hermie J; Stienen, Arno H A; Buurke, Jaap H; Rietman, Johan S
2015-10-09
Assistive and robotic training devices are increasingly used for rehabilitation of the hemiparetic arm after stroke, although applications for the wrist and hand are trailing behind. Furthermore, applying a training device in domestic settings may enable an increased training dose of functional arm and hand training. The objective of this study was to assess the feasibility and potential clinical changes associated with a technology-supported arm and hand training system at home for patients with chronic stroke. A dynamic wrist and hand orthosis was combined with a remotely monitored user interface with motivational gaming environment for self-administered training at home. Twenty-four chronic stroke patients with impaired arm/hand function were recruited to use the training system at home for six weeks. Evaluation of feasibility involved training duration, usability and motivation. Clinical outcomes on arm/hand function, activity and participation were assessed before and after six weeks of training and at two-month follow-up. Mean System Usability Scale score was 69 % (SD 17 %), mean Intrinsic Motivation Inventory score was 5.2 (SD 0.9) points, and mean training duration per week was 105 (SD 66) minutes. Median Fugl-Meyer score improved from 37 (IQR 30) pre-training to 41 (IQR 32) post-training and was sustained at two-month follow-up (40 (IQR 32)). The Stroke Impact Scale improved from 56.3 (SD 13.2) pre-training to 60.0 (SD 13.9) post-training, with a trend at follow-up (59.8 (SD 15.2)). No significant improvements were found on the Action Research Arm Test and Motor Activity Log. Remotely monitored post-stroke training at home applying gaming exercises while physically supporting the wrist and hand showed to be feasible: participants were able and motivated to use the training system independently at home. Usability shows potential, although several usability issues need further attention. Upper extremity function and quality of life improved after training, although dexterity did not. These findings indicate that home-based arm and hand training with physical support from a dynamic orthosis is a feasible tool to enable self-administered practice at home. Such an approach enables practice without dependence on therapist availability, allowing an increase in training dose with respect to treatment in supervised settings. This study has been registered at the Netherlands Trial Registry (NTR): NTR3669 .
Monkman, Helen; Kushniruk, Andre
2013-01-01
The prevalence of consumer health information systems is increasing. However, usability and health literacy impact both the value and adoption of these systems. Health literacy and usability are closely related in that systems may not be used accurately if users cannot understand the information therein. Thus, it is imperative to focus on mitigating the demands on health literacy in consumer health information systems. This study modified two usability evaluation methods (heuristic evaluation and usability testing) to incorporate the identification of potential health literacy issues in a Personal Health Record (PHR). Heuristic evaluation is an analysis of a system performed by a usability specialist who evaluates how well the system abides by usability principles. In contrast, a usability test involves a post hoc analysis of a representative user interacting with the system. These two methods revealed several health literacy issues and suggestions to ameliorate them were made. Thus, it was demonstrated that usability methods could be successfully augmented for the purpose of investigating health literacy issues. To improve users' health knowledge, the adoption of consumer health information systems, and the accuracy of the information contained therein, it is encouraged that usability methods be applied with an added focus on health literacy.
Usability evaluation techniques in mobile commerce applications: A systematic review
NASA Astrophysics Data System (ADS)
Hussain, Azham; Mkpojiogu, Emmanuel O. C.
2016-08-01
Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.
Usability testing of a prototype multi-user telehealth kiosk.
Courtney, Karen L; Matthews, Judith T; McMillan, Julie M; Person Mecca, Laurel; Smailagic, Asim; Siewiorek, Daniel
2015-01-01
The overall purpose of this study was to learn how community-dwelling older adults would interact with our prototype multi-user telehealth kiosk and their views about its usability. Seven subjects participated in laboratory-based usability sessions to evaluate the physical design, appearance, functionality and perceived ease of use of a multi-user telehealth kiosk prototype. During usability testing participants recommended 18 new features (29% of comments), identified 15 software errors (23% of comments) and 29 user interface errors (47% of comments).
Usability: Human Research Program - Space Human Factors and Habitability
NASA Technical Reports Server (NTRS)
Sandor, Aniko; Holden, Kritina L.
2009-01-01
The Usability project addresses the need for research in the area of metrics and methodologies used in hardware and software usability testing in order to define quantifiable and verifiable usability requirements. A usability test is a human-in-the-loop evaluation where a participant works through a realistic set of representative tasks using the hardware/software under investigation. The purpose of this research is to define metrics and methodologies for measuring and verifying usability in the aerospace domain in accordance with FY09 focus on errors, consistency, and mobility/maneuverability. Usability metrics must be predictive of success with the interfaces, must be easy to obtain and/or calculate, and must meet the intent of current Human Systems Integration Requirements (HSIR). Methodologies must work within the constraints of the aerospace domain, be cost and time efficient, and be able to be applied without extensive specialized training.
Usability Testing For Android Based Application “Jogja Smart Tourism”
NASA Astrophysics Data System (ADS)
Harwati; Djati Widodo, Imam
2017-06-01
The android based application “Jogja Smart Tourism (JST)” is designed to help everyone who visited Yogyakarta to enjoy their travel. As new application, it is need to be tested for its usability before launched. Usability testing will show how easy user interfaces are to used. The objective of this research is to demonstrate the result of usability testing for application JST based on five characteristics: learnability, effectiveness, memorability, errors, and satisfaction. About 30 respondents were involved to test the usability of this application. Learnability and effectiveness is calculated from some task that should be finished by respondents, and the rest aspects are calculated from questionnaires that should be answered after simulation. There are 14 functions bound in this usability testing. The result shows total usability level is in 81.75%. Learnability testing shows that 98.8% of respondent could finish the task successfully with 87.5% in efficiency. The memorability level of respondents is good (84.5%) where their ability to fix the errors is 71.5%. And the last for satisfaction level of application interface is 66.25%. Low level of satisfaction occurred because most of respondent felt uncomfortable with landscape interface of application because they should turn their mobile phone while using JST application and also it happened because the lack of using picture and colour inside the application. Both of these becomes important note for the improvement of further applications where the interface in a portrait version is more comfort the use and also utilization of colour and the image will be the main focus to improve customer satisfaction.
Evaluation of expert system application based on usability aspects
NASA Astrophysics Data System (ADS)
Munaiseche, C. P. C.; Liando, O. E. S.
2016-04-01
Usability usually defined as a point of human acceptance to a product or a system based on understands and right reaction to an interface. The performance of web application has been influence by the quality of the interface of that web to supporting information transfer process. Preferably, before the applications of expert systems were installed in the operational environment, these applications must be evaluated first by usability testing. This research aimed to measure the usability of the expert system application using tasks as interaction media. This study uses an expert system application to diagnose skin disease in human using questionnaire method which utilize the tasks as interaction media in measuring the usability. Certain tasks were executed by the participants in observing usability value of the application. The usability aspects observed were learnability, efficiency, memorability, errors, and satisfaction. Each questionnaire question represent aspects of usability. The results present the usability value for each aspect and the total average merit for all the five-usability aspect was 4.28, this indicated that the tested expert system application is in the range excellent for the usability level, so the application can be implemented as the operated system by user. The main contribution of the study is the research became the first step in using task model in the usability evaluation for the expert system application software.
The Influence of Product Aesthetics and User State in Usability Testing
ERIC Educational Resources Information Center
Sauer, Juergen; Sonderegger, Andreas
2011-01-01
An empirical study examined the effects of two influencing factors in usability tests on user performance and usability ratings. Product aesthetics (high vs. low) as the main independent factor and prior usage event (positive vs. negative) as a subsidiary independent factor were varied in a between-participants design. 60 participants took part in…
Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records.
Press, Anne; DeStio, Catherine; McCullagh, Lauren; Kapoor, Sandeep; Morley, Jeanne; Conigliaro, Joseph
2016-07-08
Screening, brief intervention, and referral to treatment (SBIRT) is currently being implemented into health systems nationally via paper and electronic methods. The purpose of this study was to evaluate the integration of an electronic SBIRT tool into an existing paper-based SBIRT clinical workflow in a patient-centered medical home. Usability testing was conducted in an academic ambulatory clinic. Two rounds of usability testing were done with medical office assistants (MOAs) using a paper and electronic version of the SBIRT tool, with two and four participants, respectively. Qualitative and quantitative data was analyzed to determine the impact of both tools on clinical workflow. A second round of usability testing was done with the revised electronic version and compared with the first version. Personal workflow barriers cited in the first round of testing were that the electronic health record (EHR) tool was disruptive to patient's visits. In Round 2 of testing, MOAs reported favoring the electronic version due to improved layout and the inclusion of an alert system embedded in the EHR. For example, using the system usability scale (SUS), MOAs reported a grade "1" for the statement, "I would like to use this system frequently" during the first round of testing but a "5" during the second round of analysis. The importance of testing usability of various mediums of tools used in health care screening is highlighted by the findings of this study. In the first round of testing, the electronic tool was reported as less user friendly, being difficult to navigate, and time consuming. Many issues faced in the first generation of the tool were improved in the second generation after usability was evaluated. This study demonstrates how usability testing of an electronic SBRIT tool can help to identify challenges that can impact clinical workflow. However, a limitation of this study was the small sample size of MOAs that participated. The results may have been biased to Northwell Health workers' perceptions of the SBIRT tool and their specific clinical workflow.
Fonda, Stephanie J; Paulsen, Christine A; Perkins, Joan; Kedziora, Richard J; Rodbard, David; Bursell, Sven-Erik
2008-02-01
Research suggests Internet-based care management tools are associated with improvements in care and patient outcomes. However, although such tools change workflow, rarely is their usability addressed and reported. This article presents a usability study of an Internet-based informatics application called the Comprehensive Diabetes Management Program (CDMP), developed by content experts and technologists. Our aim is to demonstrate a process for conducting a usability study of such a tool and to report results. We conducted the usability test with six diabetes care providers under controlled conditions. Each provider worked with the CDMP in a single session using a "think aloud" process. Providers performed standardized tasks with fictitious patient data, and we observed how they approached these tasks, documenting verbalizations and subjective ratings. The providers then completed a usability questionnaire and interviews. Overall, the scores on the usability questionnaire were neutral to favorable. For specific subdomains of the questionnaire, the providers' reported problems with the application's ease of use, performance, and support features, but were satisfied with its visual appeal and content. The results from the observational and interview data indicated areas for improvement, particularly in navigation and terminology. The usability study identified several issues for improvement, confirming the need for usability testing of Internet-based informatics applications, even those developed by experts. To our knowledge, there have been no other usability studies of an Internet-based informatics application with the functionality of the CDMP. Such studies can form the foundation for translation of Internet-based medical informatics tools into clinical practice.
Watbled, Ludivine; Marcilly, Romaric; Guerlinger, Sandra; Bastien, J-M Christian; Beuscart-Zéphir, Marie-Catherine; Beuscart, Régis
2018-02-01
Poor usability of health technology is thought to diminish work system performance, increase error rates and, potentially, harm patients. The present study (i) used a combination of usability evaluation methods to highlight the chain that leads from usability flaws to usage problems experienced by users and, ultimately, to negative patient outcomes, and (ii) validated this approach by studying two different discharge summary production systems. To comply with quality guidelines, the process of drafting and sending discharge summaries is increasingly being automated. However, the usability of these systems may modify their impact (or the absence thereof) in terms of production times and quality, and must therefore be evaluated. Here, we applied three successive techniques for usability evaluation (heuristic evaluation, user testing and field observation) to two discharge summary production systems (underpinned by different technologies). The systems' main usability flaws led respectively to an increase in the time need to produce a discharge summary and the risk of patient misidentification. Our results are discussed with regard to the possibility of linking the usability flaws, usage problems and the negative outcomes by successively applying three methods for evaluating usability (heuristic evaluation, user testing and in situ observations) throughout the system development life cycle. Copyright © 2018 Elsevier Inc. All rights reserved.
Spielberg, Freya; Kurth, Ann E; Severynen, Anneleen; Hsieh, Yu-Hsiang; Moring-Parris, Daniel; Mackenzie, Sara; Rothman, Richard
2011-06-01
Providers in emergency care settings (ECSs) often face barriers to expanded HIV testing. We undertook formative research to understand the potential utility of a computer tool, "CARE," to facilitate rapid HIV testing in ECSs. Computer tool usability and acceptability were assessed among 35 adult patients, and provider focus groups were held, in two ECSs in Washington State and Maryland. The computer tool was usable by patients of varying computer literacy. Patients appreciated the tool's privacy and lack of judgment and their ability to reflect on HIV risks and create risk reduction plans. Staff voiced concerns regarding ECS-based HIV testing generally, including resources for follow-up of newly diagnosed people. Computer-delivered HIV testing support was acceptable and usable among low-literacy populations in two ECSs. Such tools may help circumvent some practical barriers associated with routine HIV testing in busy settings though linkages to care will still be needed.
The Development of MSFC Usability Lab
NASA Technical Reports Server (NTRS)
Cheng, Yiwei; Richardson, Sally
2010-01-01
This conference poster reviews the development of the usability lab at Marshall Space Flight Center. The purpose of the lab was to integrate a fully functioning usability laboratory to provide a resource for future human factor assessments. and to implement preliminary usability testing on a MSFC website to validate the functionality of the lab.
Adequate number of clinicians on usability tests lacking, says study.
2015-12-01
A new study reveals that some of the largest EMR vendors failed to meet certification standards, specifying that they state their user-centered design processes, and that they include at least 15 representative end-user participants in their usability tests. It is not clear why these vendors were certified despite not meeting the standards established by Office of the National Coordinator for Health Information Technology (ONC), but investigators suggest that emergency clinicians and administrators should engage with vendors early on, querying them about their user-centered processes. An analysis of the usability tests performed by 41 of some the largest EMR vendors found that 34% of them did not meet certification standards, specifying that they state their user-centered design process. Also, 63% of the vendors failed to include at least 15 representative end-users in their usability tests. Only 15% of the vendors used at least 15 participants who had clinical backgrounds in their usability tests. Experts urge clinicians to engage with EMR user groups to share best practices for optimizing specific EMR products.
Developing a quit smoking website that is usable by people with severe mental illnesses.
Ferron, Joelle C; Brunette, Mary F; McHugo, Gregory J; Devitt, Timothy S; Martin, Wendy M; Drake, Robert E
2011-01-01
Evidence-based treatments may be delivered in computerized, web-based formats. This strategy can deliver the intervention consistently with minimal treatment provider time and cost. However, standard web sites may not be usable by people with severe mental illnesses who may experience cognitive deficits and low computer experience. This manuscript reports on the iterative development and usability testing of a website designed to educate and motivate adults with severe mental illnesses to engage in smoking cessation activities. Three phases of semi-structured interviews were performed with participants after they used the program and combined with information from screen-recorded usability data. T-tests compared the differences between uses of the first computer program version and a later version. Iteratively conducted usability tests demonstrated an increased ease of use from the first to the last version of the website through significant improvement in the percentage of unproductive clicking along with fewer questions asked about how to use the program. The improvement in use of the website resulted from changes such as: integrating a mouse tutorial, increasing font sizes, and increasing button sizes. The website usability recommendations provide some guidelines for interventionists developing web tools for people who experience serious psychiatric disabilities. In general, insights from the study highlight the need for thoughtful design and usability testing when creating a website for people with severe mental illness.
Usability Evaluation of a Clinical Decision Support System for Geriatric ED Pain Treatment.
Genes, Nicholas; Kim, Min Soon; Thum, Frederick L; Rivera, Laura; Beato, Rosemary; Song, Carolyn; Soriano, Jared; Kannry, Joseph; Baumlin, Kevin; Hwang, Ula
2016-01-01
Older adults are at risk for inadequate emergency department (ED) pain care. Unrelieved acute pain is associated with poor outcomes. Clinical decision support systems (CDSS) hold promise to improve patient care, but CDSS quality varies widely, particularly when usability evaluation is not employed. To conduct an iterative usability and redesign process of a novel geriatric abdominal pain care CDSS. We hypothesized this process would result in the creation of more usable and favorable pain care interventions. Thirteen emergency physicians familiar with the Electronic Health Record (EHR) in use at the study site were recruited. Over a 10-week period, 17 1-hour usability test sessions were conducted across 3 rounds of testing. Participants were given 3 patient scenarios and provided simulated clinical care using the EHR, while interacting with the CDSS interventions. Quantitative System Usability Scores (SUS), favorability scores and qualitative narrative feedback were collected for each session. Using a multi-step review process by an interdisciplinary team, positive and negative usability issues in effectiveness, efficiency, and satisfaction were considered, prioritized and incorporated in the iterative redesign process of the CDSS. Video analysis was used to determine the appropriateness of the CDS appearances during simulated clinical care. Over the 3 rounds of usability evaluations and subsequent redesign processes, mean SUS progressively improved from 74.8 to 81.2 to 88.9; mean favorability scores improved from 3.23 to 4.29 (1 worst, 5 best). Video analysis revealed that, in the course of the iterative redesign processes, rates of physicians' acknowledgment of CDS interventions increased, however most rates of desired actions by physicians (such as more frequent pain score updates) decreased. The iterative usability redesign process was instrumental in improving the usability of the CDSS; if implemented in practice, it could improve geriatric pain care. The usability evaluation process led to improved acknowledgement and favorability. Incorporating usability testing when designing CDSS interventions for studies may be effective to enhance clinician use.
Current State of Agile User-Centered Design: A Survey
NASA Astrophysics Data System (ADS)
Hussain, Zahid; Slany, Wolfgang; Holzinger, Andreas
Agile software development methods are quite popular nowadays and are being adopted at an increasing rate in the industry every year. However, these methods are still lacking usability awareness in their development lifecycle, and the integration of usability/User-Centered Design (UCD) into agile methods is not adequately addressed. This paper presents the preliminary results of a recently conducted online survey regarding the current state of the integration of agile methods and usability/UCD. A world wide response of 92 practitioners was received. The results show that the majority of practitioners perceive that the integration of agile methods with usability/UCD has added value to their adopted processes and to their teams; has resulted in the improvement of usability and quality of the product developed; and has increased the satisfaction of the end-users of the product developed. The top most used HCI techniques are low-fidelity prototyping, conceptual designs, observational studies of users, usability expert evaluations, field studies, personas, rapid iterative testing, and laboratory usability testing.
Usability Evaluation of a Private Social Network on Mental Health for Relatives.
Toribio-Guzmán, José Miguel; García-Holgado, Alicia; Soto Pérez, Felipe; García-Peñalvo, Francisco J; Franco Martín, Manuel
2017-09-01
Usability is one of the most prominent criteria that must be fulfilled by a software product. This study aims to evaluate the usability of SocialNet, a private social network for monitoring the daily progress of patients by their relatives, using a mixed usability approach: heuristic evaluation conducted by experts and user testing. A double heuristic evaluation with one expert evaluator identified the issues related to consistency, design, and privacy. User testing was conducted on 20 users and one evaluator using observation techniques and questionnaires. The main usability problems were found to be related to the structure of SocialNet, and the users presented some difficulties in locating the buttons or links. The results show a high level of usability and satisfaction with the product. This evaluation provides data on the usability of SocialNet based on the difficulties experienced by the users and the expert. The results help in redesigning the tool to resolve the identified problems as part of an iterative process.
Scandurra, I; Hägglund, M; Koch, S; Lind, M
2008-01-01
Using participatory design, we developed and deployed a mobile Virtual Health Record (VHR) on a personal digital assistant (PDA) together with experienced homecare staff. To assess transferability to a second setting and usability when used by novice users with limited system education the application was tested in a usability lab. Eight participants from another homecare district performed tasks related to daily homecare work using the VHR. Test protocols were analyzed with regard to effectiveness, potential usability problems and user satisfaction. Usability problems having impact on system performance and contextual factors affecting system transferability were uncovered. Questionnaires revealed that the participants frequently used computers, but never PDAs. Surprisingly there were only minor differences in input efficiency between novice and experienced users. The participants were overall satisfied with the application. However, transfer to another district can not be performed, unless by means of careful field observations of contextual differences. PMID:19415140
Press, Anne; McCullagh, Lauren; Khan, Sundas; Schachter, Andy; Pardo, Salvatore; McGinn, Thomas
2015-09-10
As the electronic health record (EHR) becomes the preferred documentation tool across medical practices, health care organizations are pushing for clinical decision support systems (CDSS) to help bring clinical decision support (CDS) tools to the forefront of patient-physician interactions. A CDSS is integrated into the EHR and allows physicians to easily utilize CDS tools. However, often CDSS are integrated into the EHR without an initial phase of usability testing, resulting in poor adoption rates. Usability testing is important because it evaluates a CDSS by testing it on actual users. This paper outlines the usability phase of a study, which will test the impact of integration of the Wells CDSS for pulmonary embolism (PE) diagnosis into a large urban emergency department, where workflow is often chaotic and high stakes decisions are frequently made. We hypothesize that conducting usability testing prior to integration of the Wells score into an emergency room EHR will result in increased adoption rates by physicians. The objective of the study was to conduct usability testing for the integration of the Wells clinical prediction rule into a tertiary care center's emergency department EHR. We conducted usability testing of a CDS tool in the emergency department EHR. The CDS tool consisted of the Wells rule for PE in the form of a calculator and was triggered off computed tomography (CT) orders or patients' chief complaint. The study was conducted at a tertiary hospital in Queens, New York. There were seven residents that were recruited and participated in two phases of usability testing. The usability testing employed a "think aloud" method and "near-live" clinical simulation, where care providers interacted with standardized patients enacting a clinical scenario. Both phases were audiotaped, video-taped, and had screen-capture software activated for onscreen recordings. Phase I: Data from the "think-aloud" phase of the study showed an overall positive outlook on the Wells tool in assessing a patient for a PE diagnosis. Subjects described the tool as "well-organized" and "better than clinical judgment". Changes were made to improve tool placement into the EHR to make it optimal for decision-making, auto-populating boxes, and minimizing click fatigue. Phase II: After incorporating the changes noted in Phase 1, the participants noted tool improvements. There was less toggling between screens, they had all the clinical information required to complete the tool, and were able to complete the patient visit efficiently. However, an optimal location for triggering the tool remained controversial. This study successfully combined "think-aloud" protocol analysis with "near-live" clinical simulations in a usability evaluation of a CDS tool that will be implemented into the emergency room environment. Both methods proved useful in the assessment of the CDS tool and allowed us to refine tool usability and workflow.
NASA Technical Reports Server (NTRS)
Siarto, Jeff; Reese, Mark; Shum, Dana; Baynes, Katie
2016-01-01
User experience and visual design are greatly improved when usability testing is performed on a periodic basis. Design decisions should be tested by real users so that application owners can understand the effectiveness of each decision and identify areas for improvement. It is important that applications be tested not just once, but as a part of a continuing process that looks to build upon previous tests. NASA's Earthdata Search Client has undergone a usability study to ensure its users' needs are being met and that users understand how to use the tool efficiently and effectively. This poster will highlight the process followed for usability study, the results of the study, and what has been implemented in light of the results to improve the application's interface.
The use of fault reporting of medical equipment to identify latent design flaws.
Flewwelling, C J; Easty, A C; Vicente, K J; Cafazzo, J A
2014-10-01
Poor device design that fails to adequately account for user needs, cognition, and behavior is often responsible for use errors resulting in adverse events. This poor device design is also often latent, and could be responsible for "No Fault Found" (NFF) reporting, in which medical devices sent for repair by clinical users are found to be operating as intended. Unresolved NFF reports may contribute to incident under reporting, clinical user frustration, and biomedical engineering technologist inefficacy. This study uses human factors engineering methods to investigate the relationship between NFF reporting frequency and device usability. An analysis of medical equipment maintenance data was conducted to identify devices with a high NFF reporting frequency. Subsequently, semi-structured interviews and heuristic evaluations were performed in order to identify potential usability issues. Finally, usability testing was conducted in order to validate that latent usability related design faults result in a higher frequency of NFF reporting. The analysis of medical equipment maintenance data identified six devices with a high NFF reporting frequency. Semi-structured interviews, heuristic evaluations and usability testing revealed that usability issues caused a significant portion of the NFF reports. Other factors suspected to contribute to increased NFF reporting include accessory issues, intermittent faults and environmental issues. Usability testing conducted on three of the devices revealed 23 latent usability related design faults. These findings demonstrate that latent usability related design faults manifest themselves as an increase in NFF reporting and that devices containing usability related design faults can be identified through an analysis of medical equipment maintenance data. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.
Using Cluster Analysis to Extend Usability Testing to Instructional Content. CRESST Report 816
ERIC Educational Resources Information Center
Kerr, Deirdre S.; Chung, Gregory K. W. K.
2012-01-01
Commercial video games undergo usability studies to determine the degree to which the player is able to learn, control, and understand the game. Usability studies allow game designers to improve their games before they are released to the public. If usability studies could be expanded to include information about the presentation of the…
Usability Testing of a Multimedia e-Learning Resource for Electrolyte and Acid-Base Disorders
ERIC Educational Resources Information Center
Davids, Mogamat Razeen; Chikte, Usuf; Grimmer-Somers, Karen; Halperin, Mitchell L.
2014-01-01
The usability of computer interfaces may have a major influence on learning. Design approaches that optimize usability are commonplace in the software development industry but are seldom used in the development of e-learning resources, especially in medical education. We conducted a usability evaluation of a multimedia resource for teaching…
NASA Technical Reports Server (NTRS)
Prasad, Narashimha S.; Taylor, Patrick J.; Trivedi, Sudhir B.; Kutcher, Susan
2010-01-01
We report the results of fabrication and testing of a thermoelectric power generation module. The module was fabricated using a new "flip-chip" module assembly technique that is scalable and modular. This technique results in a low value of contact resistivity ( < or = 10(exp 5) Ohms-sq cm). It can be used to leverage new advances in thin-film and nanostructured materials for the fabrication of new miniature thermoelectric devices. It may also enable monolithic integration of large devices or tandem arrays of devices on flexible or curved surfaces. Under mild testing, a power of 22 mW/sq cm was obtained from small (<100 K) temperature differences. At higher, more realistic temperature differences, approx.500 K, where the efficiency of these materials greatly improves, this power density would scale to between 0.5 and 1 Watt/cm2. These results highlight the excellent potential for the generation and scavenging of electrical power of practical and usable magnitude for remote applications using thermoelectric power generation technologies.
UserTesting.com: A Tool for Usability Testing of Online Resources
ERIC Educational Resources Information Center
Koundinya, Vikram; Klink, Jenna; Widhalm, Melissa
2017-01-01
Extension educators are increasingly using online resources in their program design and delivery. Usability testing is essential for ensuring that these resources are relevant and useful to learners. On the basis of our experiences with iteratively developing products using a testing service called UserTesting, we promote the use of fee-based…
Russ, Alissa L; Weiner, Michael; Russell, Scott A; Baker, Darrell A; Fahner, W Jeffrey; Saleem, Jason J
2012-12-01
Although the potential benefits of more usable health information technologies (HIT) are substantial-reduced HIT support costs, increased work efficiency, and improved patient safety--human factors methods to improve usability are rarely employed. The US Department of Veterans Affairs (VA) has emerged as an early leader in establishing usability laboratories to inform the design of HIT, including its electronic health record. Experience with a usability laboratory at a VA Medical Center provides insights on how to design, implement, and leverage usability laboratories in the health care setting. The VA Health Services Research and Development Service Human-Computer Interaction & Simulation Laboratory emerged as one of the first VA usability laboratories and was intended to provide research-based findings about HIT designs. This laboratory supports rapid prototyping, formal usability testing, and analysis tools to assess existing technologies, alternative designs, and potential future technologies. RESULTS OF IMPLEMENTATION: Although the laboratory has maintained a research focus, it has become increasingly integrated with VA operations, both within the medical center and on a national VA level. With this resource, data-driven recommendations have been provided for the design of HIT applications before and after implementation. The demand for usability testing of HIT is increasing, and information on how to develop usability laboratories for the health care setting is often needed. This article may assist other health care organizations that want to invest in usability resources to improve HIT. The establishment and utilization of usability laboratories in the health care setting may improve HIT designs and promote safe, high-quality care for patients.
Usability testing of a monitoring and feedback tool to stimulate physical activity.
van der Weegen, Sanne; Verwey, Renée; Tange, Huibert J; Spreeuwenberg, Marieke D; de Witte, Luc P
2014-01-01
A MONITORING AND FEEDBACK TOOL TO STIMULATE PHYSICAL ACTIVITY, CONSISTING OF AN ACTIVITY SENSOR, SMARTPHONE APPLICATION (APP), AND WEBSITE FOR PATIENTS AND THEIR PRACTICE NURSES, HAS BEEN DEVELOPED: the 'It's LiFe!' tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40-70 years), to improve the user interfaces and content of the tool. THE STUDY HAD FOUR PHASES: 1) a heuristic evaluation with six technology experts; 2) a usability test in a laboratory by five patients; 3) a pilot in real life wherein 20 patients used the tool for 3 months; and 4) a final lab test by five patients. In both lab tests (phases 2 and 4) qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ) was completed for the app and the website. In the pilot test (phase 3), all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI) was completed. After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server, implemented after connectivity problems in the pilot test. The mean score on the PSSUQ for the website improved from 5.6 (standard deviation [SD] 1.3) to 6.5 (SD 0.5), and for the app from 5.4 (SD 1.5) to 6.2 (SD 1.1). Satisfaction in the pilot was not very high according to the SUMI. The use of laboratory versus real-life tests and expert-based versus user-based tests revealed a wide range of usability issues. The usability of the It's LiFe! tool improved considerably during the study.
ERIC Educational Resources Information Center
Davids, Mogamat Razeen; Harvey, Justin; Halperin, Mitchell L.; Chikte, Usuf M. E.
2015-01-01
The usability of computer interfaces has a major influence on learning. Optimising the usability of e-learning resources is therefore essential. However, this may be neglected because of time and monetary constraints. User testing is a common approach to usability evaluation and involves studying typical end-users interacting with the application…
Bello, Caroline; Roseth, Arne; Guardiola, Jordi; Reenaers, Catherine; Ruiz-Cerulla, Alexandra; Van Kemseke, Catherine; Arajol, Claudia; Reinhard, Christian; Seidel, Laurence; Louis, Edouard
2017-09-01
The aim of our work was to test the usability of fecal calprotectin (FC) home-based test in inflammatory bowel disease (IBD) patients. IBD patients were prospectively recruited. They had to measure FC with a dedicated tool and smartphone application, 5 times at two weeks intervals over an 8 weeks period. They had to fill in a usability questionnaire at the first and the last FC measurement. A System Usability Scale (SUS: 0-100) and the Global Score of Usability (GSU: 0-85) were calculated. FC was also centrally measured by ELISA. Fifty-eight patients were recruited. Forty-two performed at least one FC measurement and 27 performed all the FC requested measurements. The median (IQR) SUS (0-100) at the first and last use were 85 (78-90) and 81 (70-88), respectively; the median (IQR) GSU (0-85) at the first and last use were 74 (69-80) and 77 (68-83), respectively. Adherence to the planned measurements and usability of the tool were higher in females and in less severe disease. The intra-class correlation coefficient between home-based and centrally measured FC was 0.88. The adherence to home-based measurement of FC was fair. Usability scores for the home-based test were high. There was a good correlation with the centrally measured FC by ELISA. Copyright © 2017 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.
Human Factors for Nursing: From In-Situ Testing to Mobile Usability Engineering.
Kushniruk, Andre W; Borycki, Elizabeth M; Solvoll, Terje; Hullin, Carola
2016-01-01
The tutorial goal is to familiarize participants with human aspects of health informatics and human-centered approaches to the design, evaluation and deployment of both usable and safe healthcare information systems. The focus will be on demonstrating and teaching practical and low-cost methods for evaluating mobile applications in nursing. Basic background to testing methods will be provided, followed by live demonstration of the methods. Then the audience will break into small groups to explore the application of the methods to applications of interest (there will be a number of possible applications that will be available for applications in areas such as electronic health records and decision support, however, if the groups have applications of specific interest to them that will be possible). The challenges of conducting usability testing, and in particular mobile usability testing will be discussed along with practical solutions. The target audience includes practicing nurses and nurse researchers, nursing informatics specialists, nursing students, nursing managers and health informatics professionals interested in improving the usability and safety of healthcare applications.
Couture, Brittany; Lilley, Elizabeth; Chang, Frank; DeBord Smith, Ann; Cleveland, Jessica; Ergai, Awatef; Katsulis, Zachary; Benneyan, James; Gershanik, Esteban; Bates, David W; Collins, Sarah A
2018-04-01
Developing an optimized and user-friendly mHealth application for patients and family members in the hospital environment presents unique challenges given the diverse patient population and patients' various states of well-being. This article describes user-centered design methods and results for developing the patient and family facing user interface and functionality of MySafeCare, a safety reporting tool for hospitalized patients and their family members. Individual and group usability sessions were conducted with specific testing scenarios for participants to follow to test the usability and functionality of the tool. Participants included patients, family members, and Patient and Family Advisory Council (PFAC) members. Engagement rounds were also conducted on study units and lessons learned provided additional information to the usability work. Usability results were aligned with Nielsen's Usability Heuristics. Eleven patients and family members and 25 PFAC members participated in usability testing and over 250 patients and family members were engaged during research team rounding. Specific themes resulting from the usability testing sessions influenced the changes made to the user interface design, workflow functionality, and terminology. User-centered design should focus on workflow functionality, terminology, and user interface issues for mHealth applications. These themes illustrated issues aligned with four of Nielsen's Usability Heuristics: match between system and the real world, consistency and standards, flexibility and efficiency of use, and aesthetic and minimalist design. We identified workflow and terminology issues that may be specific to the use of an mHealth application focused on safety and used by hospitalized patients and their families. Schattauer GmbH Stuttgart.
The Feasibility and Acceptability of Google Glass for Teletoxicology Consults.
Chai, Peter R; Babu, Kavita M; Boyer, Edward W
2015-09-01
Teletoxicology offers the potential for toxicologists to assist in providing medical care at remote locations, via remote, interactive augmented audiovisual technology. This study examined the feasibility of using Google Glass, a head-mounted device that incorporates a webcam, viewing prism, and wireless connectivity, to assess the poisoned patient by a medical toxicology consult staff. Emergency medicine residents (resident toxicology consultants) rotating on the toxicology service wore Glass during bedside evaluation of poisoned patients; Glass transmitted real-time video of patients' physical examination findings to toxicology fellows and attendings (supervisory consultants), who reviewed these findings. We evaluated the usability (e.g., quality of connectivity and video feeds) of Glass by supervisory consultants, as well as attitudes towards use of Glass. Resident toxicology consultants and supervisory consultants completed 18 consults through Glass. Toxicologists viewing the video stream found the quality of audio and visual transmission usable in 89 % of cases. Toxicologists reported their management of the patient changed after viewing the patient through Glass in 56 % of cases. Based on findings obtained through Glass, toxicologists recommended specific antidotes in six cases. Head-mounted devices like Google Glass may be effective tools for real-time teletoxicology consultation.
Framework of sensor-based monitoring for pervasive patient care.
Triantafyllidis, Andreas K; Koutkias, Vassilis G; Chouvarda, Ioanna; Adami, Ilia; Kouroubali, Angelina; Maglaveras, Nicos
2016-09-01
Sensor-based health systems can often become difficult to use, extend and sustain. The authors propose a framework for designing sensor-based health monitoring systems aiming to provide extensible and usable monitoring services in the scope of pervasive patient care. The authors' approach relies on a distributed system for monitoring the patient health status anytime-anywhere and detecting potential health complications, for which healthcare professionals and patients are notified accordingly. Portable or wearable sensing devices measure the patient's physiological parameters, a smart mobile device collects and analyses the sensor data, a Medical Center system receives notifications on the detected health condition, and a Health Professional Platform is used by formal caregivers in order to review the patient condition and configure monitoring schemas. A Service-oriented architecture is utilised to provide extensible functional components and interoperable interactions among the diversified system components. The framework was applied within the REMOTE ambient-assisted living project in which a prototype system was developed, utilising Bluetooth to communicate with the sensors and Web services for data exchange. A scenario of using the REMOTE system and preliminary usability results show the applicability, usefulness and virtue of our approach.
Framework of sensor-based monitoring for pervasive patient care
Koutkias, Vassilis G.; Chouvarda, Ioanna; Adami, Ilia; Kouroubali, Angelina; Maglaveras, Nicos
2016-01-01
Sensor-based health systems can often become difficult to use, extend and sustain. The authors propose a framework for designing sensor-based health monitoring systems aiming to provide extensible and usable monitoring services in the scope of pervasive patient care. The authors’ approach relies on a distributed system for monitoring the patient health status anytime-anywhere and detecting potential health complications, for which healthcare professionals and patients are notified accordingly. Portable or wearable sensing devices measure the patient's physiological parameters, a smart mobile device collects and analyses the sensor data, a Medical Center system receives notifications on the detected health condition, and a Health Professional Platform is used by formal caregivers in order to review the patient condition and configure monitoring schemas. A Service-oriented architecture is utilised to provide extensible functional components and interoperable interactions among the diversified system components. The framework was applied within the REMOTE ambient-assisted living project in which a prototype system was developed, utilising Bluetooth to communicate with the sensors and Web services for data exchange. A scenario of using the REMOTE system and preliminary usability results show the applicability, usefulness and virtue of our approach. PMID:27733920
Mohamad Marzuki, Muhamad Fadhil; Yaacob, Nor Azwany; Yaacob, Najib Majdi
2018-05-14
A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages. The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay. Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users. The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app. The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia. ©Muhamad Fadhil Mohamad Marzuki, Nor Azwany Yaacob, Najib Majdi Yaacob. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 14.05.2018.
Evaluation of a Telerehabilitation System for Community-Based Rehabilitation
Schutte, Jamie; Gales, Sara; Filippone, Ashlee; Saptono, Andi; Parmanto, Bambang; McCue, Michael
2012-01-01
The use of web-based portals, while increasing in popularity in the fields of medicine and research, are rarely reported on in community-based rehabilitation programs. A program within the Pennsylvania Office of Vocational Rehabilitation’s Hiram G. Andrews Center, the Cognitive Skills Enhancement Program (CSEP), sought to enhance organization of program and participant information and communication between part- and full-time employees, supervisors and consultants. A telerehabilitation system was developed consisting of (1) a web-based portal to support a variety of clinical activities, and (2) the Versatile Integrated System for Telerehabilitation (VISYTER) video-conferencing system to support the collaboration and delivery of rehabilitation services remotely. This descriptive evaluation examines the usability of the telerehabilitation system incorporating both the portal and VISYTER. Telerehabilitation system users include CSEP staff members from three geographical locations and employed by two institutions. The IBM After-Scenario Questionnaire (ASQ) and Post-Study System Usability Questionnaire (PSSUQ), the Telehealth Usability Questionnaire (TUQ), and two demographic surveys were administered to gather both objective and subjective information. Results showed generally high levels of usability. Users commented that the telerehabilitation system improved communication, increased access to information, improved speed of completing tasks, and had an appealing interface. Areas where users would like to see improvements, including ease of accessing/editing documents and searching for information, are discussed. PMID:25945193
Designing an Affordable Usability Test for E-Learning Modules
ERIC Educational Resources Information Center
O'Bryan, Corliss A.; Johnson, Donald M.; Shores-Ellis, Katrina D.; Crandall, Philip G.; Marcy, John A.; Seideman, Steve C.; Ricke, Steven C.
2010-01-01
This article provides background and an introduction to a user-centered design and usability test in an inexpensive format that allows content experts who are novices in e-learning development to perform testing on newly developed technical training modules prior to their release. The use of a small number of test participants, avoidance of…
Hohenstein, Jess; O'Dell, Dakota; Murnane, Elizabeth L; Lu, Zhengda; Erickson, David; Gay, Geri
2017-11-21
In today's health care environment, increasing costs and inadequate medical resources have created a worldwide need for more affordable diagnostic tools that are also portable, fast, and easy to use. To address this issue, numerous research and commercial efforts have focused on developing rapid diagnostic technologies; however, the efficacy of existing systems has been hindered by usability problems or high production costs, making them infeasible for deployment in at-home, point-of-care (POC), or resource-limited settings. The aim of this study was to create a low-cost optical reader system that integrates with any smart device and accepts any type of rapid diagnostic test strip to provide fast and accurate data collection, sample analysis, and diagnostic result reporting. An iterative design methodology was employed by a multidisciplinary research team to engineer three versions of a portable diagnostic testing device that were evaluated for usability and overall user receptivity. Repeated design critiques and usability studies identified a number of system requirements and considerations (eg, software compatibility, biomatter contamination, and physical footprint) that we worked to incrementally incorporate into successive system variants. Our final design phase culminated in the development of Tidbit, a reader that is compatible with any Wi-Fi-enabled device and test strip format. The Tidbit includes various features that support intuitive operation, including a straightforward test strip insertion point, external indicator lights, concealed electronic components, and an asymmetric shape, which inherently signals correct device orientation. Usability testing of the Tidbit indicates high usability for potential user communities. This study presents the design process, specification, and user reception of the Tidbit, an inexpensive, easy-to-use, portable optical reader for fast, accurate quantification of rapid diagnostic test results. Usability testing suggests that the reader is usable among and can benefit a wide group of potential users, including in POC contexts. Generally, the methodology of this study demonstrates the importance of testing these types of systems with potential users and exemplifies how iterative design processes can be employed by multidisciplinary research teams to produce compelling technological solutions. ©Jess Hohenstein, Dakota O'Dell, Elizabeth L Murnane, Zhengda Lu, David Erickson, Geri Gay. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 21.11.2017.
Airborne lidar experiments at the Savannah River Plant
NASA Technical Reports Server (NTRS)
Krabill, William B.; Swift, Robert N.
1985-01-01
The results of remote sensing experiments at the Department of Energy (DOE) Savannah River Nuclear Facility utilizing the NASA Airborne Oceanographic Lidar (AOL) are presented. The flights were conducted in support of the numerous environmental monitoring requirements associated with the operation of the facility and for the purpose of furthering research and development of airborne lidar technology. Areas of application include airborne laser topographic mapping, hydrologic studies using fluorescent tracer dye, timber volume estimation, baseline characterization of wetlands, and aquatic chlorophyll and photopigment measurements. Conclusions relative to the usability of airborne lidar technology for the DOE for each of these remote sensing applications are discussed.
ERIC Educational Resources Information Center
Packer, Jaclyn; Reuschel, William
2018-01-01
Introduction: Accessibility of Voice over Internet Protocol (VoIP) systems was tested with a hands-on usability study and an online survey of VoIP users who are visually impaired. The survey examined the importance of common VoIP features, and both methods assessed difficulty in using those features. Methods: The usability test included four paid…
Jaja, Cheedy; Pares-Avila, Jose; Wolpin, Seth; Berry, Donna
2010-04-01
The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.
Modi, Avani C; Schmidt, Matthew; Smith, Aimee W; Turnier, Luke; Glaser, Noah; Wade, Shari L
2017-07-01
Youth with epilepsy exhibit significant deficits in executive functioning (EF), yet there are few interventions to improve EF for adolescents. The aims of the current study were to develop an individually-tailored intervention, called Epilepsy Journey, to improve aspects of EF through an iterative, patient-centered process including focus groups and usability testing. Five adolescents and caregivers participated in focus groups. This input was used to develop ten learning modules based on subscales of the Behavioral Rating Inventory of Executive Functions and key issues that may impact EF in adolescents. Six adolescents participated in usability testing and a usability expert conducted a heuristic evaluation. Demographic information, chart reviews and measures of EF were also completed. Focus group participants and their parents reported difficulties with memory, attention, organization, monitoring, initiation, impulsivity, emotional control, sleep, awareness in schools and managing stress. They also identified successful strategies to address memory and organizational difficulties. Usability testing of the resultant Epilepsy Journey modules revealed problems with navigation and identified features that promoted usability, including progress bars and interactive modules. Program modifications were made after each usability trial resulting in a relatively brief, interactive and readily navigable program. Perceived utility was high with all but one participant. Participants rated the content as helpful and indicated they would recommend Epilepsy Journey to others. Feedback from the focus group and usability testing yielded a feasible, acceptable, relevant and user-friendly web-based intervention for adolescents with epilepsy. The Epilepsy Journey program will be further tested in an open pilot with adolescents with epilepsy and associated EF deficits. Copyright © 2017 Elsevier Inc. All rights reserved.
2013-01-01
Background Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient’s perspective. Methods The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients’ treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. Results 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Conclusions Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing. PMID:24289731
Li, Linda C; Adam, Paul M; Townsend, Anne F; Lacaille, Diane; Yousefi, Charlene; Stacey, Dawn; Gromala, Diane; Shaw, Chris D; Tugwell, Peter; Backman, Catherine L
2013-12-01
Decision aids are evidence-based tools designed to inform people of the potential benefit and harm of treatment options, clarify their preferences and provide a shared decision-making structure for discussion at a clinic visit. For patients with rheumatoid arthritis (RA) who are considering methotrexate, we have developed a web-based patient decision aid called the ANSWER (Animated, Self-serve, Web-based Research Tool). This study aimed to: 1) assess the usability of the ANSWER prototype; 2) identify strengths and limitations of the ANSWER from the patient's perspective. The ANSWER prototype consisted of: 1) six animated patient stories and narrated information on the evidence of methotrexate for RA; 2) interactive questionnaires to clarify patients' treatment preferences. Eligible participants for the usability test were patients with RA who had been prescribed methotrexate. They were asked to verbalize their thoughts (i.e., think aloud) while using the ANSWER, and to complete the System Usability Scale (SUS) to assess overall usability (range = 0-100; higher = more user friendly). Participants were audiotaped and observed, and field notes were taken. The testing continued until no new modifiable issues were found. We used descriptive statistics to summarize participant characteristics and the SUS scores. Content analysis was used to identified usability issues and navigation problems. 15 patients participated in the usability testing. The majority were aged 50 or over and were university/college graduates (n = 8, 53.4%). On average they took 56 minutes (SD = 34.8) to complete the tool. The mean SUS score was 81.2 (SD = 13.5). Content analysis of audiotapes and field notes revealed four categories of modifiable usability issues: 1) information delivery (i.e., clarity of the information and presentation style); 2) navigation control (i.e., difficulties in recognizing and using the navigation control buttons); 3) layout (i.e., position of the videos, text, diagrams and navigation buttons); 4) aesthetic (i.e., the colour, look and feel of the online tool). Although the SUS score indicated high usability before and after major modification, findings from the think-aloud sessions illustrated areas that required further refinement. Our results highlight the importance of formative evaluation in usability testing.
Usability in the real world: assessing medical information technologies in patients' homes.
Kaufman, David R; Patel, Vimla L; Hilliman, Charlyn; Morin, Philip C; Pevzner, Jenia; Weinstock, Ruth S; Goland, Robin; Shea, Steven; Starren, Justin
2003-01-01
This paper presents an approach to usability evaluation of computer-based health care systems designed for patient use in their homes. Although such devices are becoming more prevalent, there is very little known about their usability. The theoretical foundations for the methods are discussed. The approach incorporates a cognitive walkthrough usability evaluation and new methods for usability testing that can be conducted in patient's homes. The method was applied to the IDEATel intervention, a multi-institution randomized controlled trial of the feasibility, acceptability, and clinical utility of a home-based telemedicine system for diabetic Medicare population. The usability study was designed to assess barriers to optimal use of the system. The focus was both on dimensions of the interface and on dimensions of patient skills and competency. The usability field research involved testing 25 patients in their homes using the system. The analysis included a range of video-analytic methods of varying levels of granularity. The usability evaluation revealed aspects of the interface that were sub-optimal and impeded the performance of certain tasks. It also found a range of patient-related factors such as numeracy and psychomotor skills that constituted barriers to productive use. A multifaceted usability approach provided important insight regarding use of technology by an elderly chronic-care patient population and more generally, for understanding how home health initiatives can more effectively use such technology.
Breakey, Vicky R; Warias, Ashley V; Ignas, Danial M; White, Meghan; Blanchette, Victor S; Stinson, Jennifer N
2013-10-04
As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, "Teens Taking Charge: Managing Hemophilia Online," was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. A purposive sample (n=18; age 13-18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a "think aloud" usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users.
[Remote access to a web-based image distribution system].
Bergh, B; Schlaefke, A; Frankenbach, R; Vogl, T J
2004-06-01
To assess different network and security technologies for remote access to a web-based image distribution system of a hospital intranet. Following preparatory testing, the time-to-display (TTD) was measured for three image types (CR, CT, MR). The evaluation included two remote access technologies consisting of direct ISDN-Dial-Up or VPN connection (Virtual Private Network), with three different connection speeds of 64, 128 (ISDN) and 768 Kbit/s (ADSL-Asymmetric Digital Subscriber Line), as well as with lossless and lossy compression. Depending on the image type, the TTD with lossless compression for 64 Kbit/s varied from 1 : 00 to 2 : 40 minutes, for 128 Kbit/s from 0 : 35 to 1 : 15 minutes and for ADSL from 0 : 15 to 0 : 45 minutes. The ISDN-Dial-Up connection was superior to VPN technology at 64 Kbit/s but did not allow higher connection speeds. Lossy compression reduced the TTD by half for all measurements. VPN technology is preferable to direct Dial-Up connections since it offers higher connection speeds and advantages in usage and security. For occasional usage, 128 Kbit/s (ISDN) can be considered sufficient, especially in conjunction with lossy compression. ADSL should be chosen when a more frequent usage is anticipated, whereby lossy compression may be omitted. Due to higher bandwidths and improved usability, the web-based approach appears superior to conventional teleradiology systems.
Advocating for Greater Usability in Clinical Technologies: The Role of the Practicing Nurse.
Lopez, Karen Dunn; Fahey, Linda
2018-06-01
Health care, especially ICUs, rely on multiple types of technology to promote the best patient outcomes. Unfortunately, too often these technologies are poorly designed, causing errors, additional workload, and unnecessary frustration. The purpose of this article is to (1) empower nurses with the needed usability and usability testing vocabulary to identify and articulate clinical technology usability problems and (2) provide ideas on ways nurses can advocate to have an impact on positive change related to technology usability within a health care organization. Copyright © 2018 Elsevier Inc. All rights reserved.
ERIC Educational Resources Information Center
Snider, Jean; Martin, Florence
2012-01-01
Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…
Barriers to comparing the usability of electronic health records.
Ratwani, Raj M; Hettinger, A Zachary; Fairbanks, Rollin J
2017-04-01
Despite the widespread adoption of electronic health records (EHRs), usability of many EHRs continues to be suboptimal, with some vendors failing to meet usability standards, resulting in clinician frustration and patient safety hazards. In an effort to increase EHR vendor competition on usability, recommendations have been made and legislation drafted to develop comparison tools that would allow purchasers to better understand the usability of EHR products prior to purchase. Usability comparison can be based on EHR vendor design and development processes, vendor usability testing as part of the Office of the National Coordinator for Health Information Technology certification program, and usability of implemented products. Barriers exist within the current certified health technology program that prevent effective comparison of usability during each of these stages. We describe the importance of providing purchasers with improved information about EHR usability, barriers to making usability comparisons, and solutions to overcome these barriers. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.
Usability study of a computer-based self-management system for older adults with chronic diseases.
Or, Calvin; Tao, Da
2012-11-08
Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.
Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases
Tao, Da
2012-01-01
Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015
Radhakrishnan, Kavita; Toprac, Paul; O'Hair, Matt; Bias, Randolph; Mackert, Mike; Xie, Bo; Kim, Miyong; Bradley, Paul
2016-01-01
Effective self-management can decrease up to 50% of heart failure (HF) hospitalizations. However, self-management by patients with HF remains poor. We describe the development and usability testing of an interactive digital e-health game (IDEG) for older patients with HF in Central Texas, USA. Majority of the participants (5 out of 6) who participated in the usability testing found the game interesting, enjoyable and helpful to play. Developing an IDEG that is satisfying and acceptable to older adults with HF is feasible.
APRN Usability Testing of a Tailored Computer-Mediated Health Communication Program
Lin, Carolyn A.; Neafsey, Patricia J.; Anderson, Elizabeth
2010-01-01
This study tested the usability of a touch-screen enabled “Personal Education Program” (PEP) with Advanced Practice Registered Nurses (APRN). The PEP is designed to enhance medication adherence and reduce adverse self-medication behaviors in older adults with hypertension. An iterative research process was employed, which involved the use of: (1) pre-trial focus groups to guide the design of system information architecture, (2) two different cycles of think-aloud trials to test the software interface, and (3) post-trial focus groups to gather feedback on the think-aloud studies. Results from this iterative usability testing process were utilized to systematically modify and improve the three PEP prototype versions—the pilot, Prototype-1 and Prototype-2. Findings contrasting the two separate think-aloud trials showed that APRN users rated the PEP system usability, system information and system-use satisfaction at a moderately high level between trials. In addition, errors using the interface were reduced by 76 percent and the interface time was reduced by 18.5 percent between the two trials. The usability testing processes employed in this study ensured an interface design adapted to APRNs' needs and preferences to allow them to effectively utilize the computer-mediated health-communication technology in a clinical setting. PMID:19940619
Beste, Dominik; Chaplin, Hema; Varakliotis, Socrates; Suffield, Linda; Josephs, Francesca; Sen, Debajit; Wedderburn, Lucy R; Ioannou, Yiannakis; Hailes, Stephen; Eleftheriou, Despina
2017-01-01
Background Flare-ups in juvenile idiopathic arthritis (JIA) are characterized by joint pain and swelling and often accompanied with fatigue, negative emotions, and reduced participation in activities. To minimize the impact of JIA on the physical and psychosocial development and well-being of young people (YP), it is essential to regularly monitor disease activity and side effects, as well as to support self-management such as adherence to treatment plans and engagement in general health-promoting behaviors. Smartphone technology has the potential to engage YP with their health care through convenient self-monitoring and easy access to information. In addition, having a more accurate summary of self-reported fluctuations in symptoms, behaviors, and psychosocial problems can help both YP and health care professionals (HCPs) better understand the patient’s condition, identify barriers to self-management, and assess treatment effectiveness and additional health care needs. No comprehensive smartphone app has yet been developed in collaboration with YP with JIA, their parents, and HCPs involved in their care. Objectives The objective of this study was to design, develop, and evaluate the acceptability and usability of JIApp, a self-management smartphone app system for YP with JIA and HCPs. Methods We used a qualitative, user-centered design approach involving YP, parents, and HCPs from the rheumatology team. The study was conducted in three phases: (1) phase I focused on developing consensus on the features, content, and design of the app; (2) phase II was used for further refining and evaluating the app prototype; and (3) phase III focused on usability testing of the app. The interview transcripts were analyzed using qualitative content analysis. Results A total of 29 YP (aged 10-23, median age 17) with JIA, 7 parents, and 21 HCPs were interviewed. Major themes identified as the ones that helped inform app development in phase I were: (1) remote monitoring of symptoms, well-being, and activities; (2) treatment adherence; and (3) education and support. During phase II, three more themes emerged that informed further refinement of the app prototype. These included (4) adapting a reward system to motivate end users for using the app; (5) design of the app interface; and (6) clinical practice integration. The usability testing during phase III demonstrated high rates of overall satisfaction and further affirmed the content validity of the app. Conclusions We present the development and evaluation of a smartphone app to encourage self-management and engagement with health care for YP with JIA. The app was found to have high levels of acceptability and usability among YP and HCPs and has the potential to improve health care and outcomes for this age group. Future feasibility testing in a prospective study will firmly establish the reliability, efficacy, and cost-effectiveness of such an app intervention for patients with arthritis. PMID:28811270
Exploratory study of the acceptance of two individual practical classes with remote labs
NASA Astrophysics Data System (ADS)
Tirado-Morueta, Ramón; Sánchez-Herrera, Reyes; Márquez-Sánchez, Marco A.; Mejías-Borrero, Andrés; Andujar-Márquez, José Manuel
2018-03-01
Remote lab experiences are proliferating in higher education, although there are still few studies that manage to build a theoretical framework for educational assessment and design of this technology. In order to explore to what extent the use of facilitators of proximity to the laboratory and the autonomy of the experiment makes remote laboratories a technology accepted by students, two remote labs different yet similar educational conditions in laboratories are used. A sample of 98 undergraduate students from a degree course in Energy Engineering was used for this study; 57 of these students ran experiments in a laboratory of electrical machines and 41 in a photovoltaic systems laboratory. The data suggest using conditions that facilitate the proximity of the laboratory and the autonomy in the realisation of the experiment; in both laboratories the experience was positively valued by the students. Also, data suggest that the types of laboratory and experiment have influences on usability - autonomy and lab proximity - perceived by students.
Measuring the Usability of Augmented Reality e-Learning Systems: A User-Centered Evaluation Approach
NASA Astrophysics Data System (ADS)
Pribeanu, Costin; Balog, Alexandru; Iordache, Dragoş Daniel
The development of Augmented Reality (AR) systems is creating new challenges and opportunities for the designers of e-learning systems. The mix of real and virtual requires appropriate interaction techniques that have to be evaluated with users in order to avoid usability problems. Formative usability aims at finding usability problems as early as possible in the development life cycle and is suitable to support the development of such novel interactive systems. This work presents an approach to the user-centered usability evaluation of an e-learning scenario for Biology developed on an Augmented Reality educational platform. The evaluation has been carried on during and after a summer school held within the ARiSE research project. The basic idea was to perform usability evaluation twice. In this respect, we conducted user testing with a small number of students during the summer school in order to get a fast feedback from users having good knowledge in Biology. Then, we repeated the user testing in different conditions and with a relatively larger number of representative users. In this paper we describe both experiments and compare the usability evaluation results.
Nitsch, Martina; Dimopoulos, Christina N; Flaschberger, Edith; Saffran, Kristina; Kruger, Jenna F; Garlock, Lindsay; Wilfley, Denise E; Taylor, Craig B; Jones, Megan
2016-01-11
Numerous digital health interventions have been developed for mental health promotion and intervention, including eating disorders. Efficacy of many interventions has been evaluated, yet knowledge about reasons for dropout and poor adherence is scarce. Most digital health intervention studies lack appropriate research design and methods to investigate individual engagement issues. User engagement and program usability are inextricably linked, making usability studies vital in understanding and improving engagement. The aim of this study was to explore engagement and corresponding usability issues of the Healthy Body Image Program-a guided online intervention for individuals with body image concerns or eating disorders. The secondary aim was to demonstrate the value of usability research in order to investigate engagement. We conducted an iterative usability study based on a mixed-methods approach, combining cognitive and semistructured interviews as well as questionnaires, prior to program launch. Two separate rounds of usability studies were completed, testing a total of 9 potential users. Thematic analysis and descriptive statistics were used to analyze the think-aloud tasks, interviews, and questionnaires. Participants were satisfied with the overall usability of the program. The average usability score was 77.5/100 for the first test round and improved to 83.1/100 after applying modifications for the second iteration. The analysis of the qualitative data revealed five central themes: layout, navigation, content, support, and engagement conditions. The first three themes highlight usability aspects of the program, while the latter two highlight engagement issues. An easy-to-use format, clear wording, the nature of guidance, and opportunity for interactivity were important issues related to usability. The coach support, time investment, and severity of users' symptoms, the program's features and effectiveness, trust, anonymity, and affordability were relevant to engagement. This study identified salient usability and engagement features associated with participant motivation to use the Healthy Body Image Program and ultimately helped improve the program prior to its implementation. This research demonstrates that improvements in usability and engagement can be achieved by testing and adjusting intervention design and content prior to program launch. The results are consistent with related research and reinforce the need for further research to identify usage patterns and effective means for reducing dropout. Digital health research should include usability studies prior to efficacy trials to help create more user-friendly programs that have a higher likelihood of "real-world" adoption.
Usability Testing: A Case Study.
ERIC Educational Resources Information Center
Chisman, Janet; Walbridge, Sharon; Diller, Karen
1999-01-01
Discusses the development and results of usability testing of Washington State University's Web-based OPAC (online public access catalog); examines how easily users could navigate the catalog and whether they understood what they were seeing; and identifies problems and what action if any was taken. (LRW)
Kurahashi, Allison M; Weinstein, Peter B; Jamieson, Trevor; Stinson, Jennifer N; Cafazzo, Joseph A; Lokuge, Bhadra; Morita, Plinio P; Cohen, Eyal; Rapoport, Adam; Bezjak, Andrea; Husain, Amna
2016-03-24
We describe the development and evaluation of a secure Web-based system for the purpose of collaborative care called Loop. Loop assembles the team of care with the patient as an integral member of the team in a secure space. The objectives of this paper are to present the iterative design of the separate views for health care providers (HCPs) within each patient's secure space and examine patients', caregivers', and HCPs' perspectives on this separate view for HCP-only communication. The overall research program includes cycles of ethnography, prototyping, usability testing, and pilot testing. This paper describes the usability testing phase that directly informed development. A descriptive qualitative approach was used to analyze participant perspectives that emerged during usability testing. During usability testing, we sampled 89 participants from three user groups: 23 patients, 19 caregivers, and 47 HCPs. Almost all perspectives from the three user groups supported the need for an HCP-only communication view. In an earlier prototype, the visual presentation caused confusion among HCPs when reading and composing messages about whether a message was visible to the patient. Usability testing guided us to design a more deliberate distinction between posting in the Patient and Team view and the Health Care Provider Only view at the time of composing a message, which once posted is distinguished by an icon. The team made a decision to incorporate an HCP-only communication view based on findings during earlier phases of work. During usability testing we tested the separate communication views, and all groups supported this partition. We spent considerable effort designing the partition; however, preliminary findings from the next phase of evaluation, pilot testing, show that the Patient and Team communication is predominantly being used. This demonstrates the importance of a subsequent phase of the clinical trial of Loop to validate the concept and design.
Does user-centred design affect the efficiency, usability and safety of CPOE order sets?
Chan, Julie; Shojania, Kaveh G; Easty, Anthony C; Etchells, Edward E
2011-05-01
Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). 27 staff physicians, residents and medical students. Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation.
Does user-centred design affect the efficiency, usability and safety of CPOE order sets?
Chan, Julie; Shojania, Kaveh G; Easty, Anthony C
2011-01-01
Background Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems. Objective We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper). Participants 27staff physicians, residents and medical students. Setting Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only. Main Measures Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety). Results 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats. Conclusions The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation. PMID:21486886
Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L
2013-09-01
Optimizing the usability of e-learning materials is necessary to maximize their potential educational impact, but this is often neglected when time and other resources are limited, leading to the release of materials that cannot deliver the desired learning outcomes. As clinician-teachers in a resource-constrained environment, we investigated whether heuristic evaluation of our multimedia e-learning resource by a panel of experts would be an effective and efficient alternative to testing with end users. We engaged six inspectors, whose expertise included usability, e-learning, instructional design, medical informatics, and the content area of nephrology. They applied a set of commonly used heuristics to identify usability problems, assigning severity scores to each problem. The identification of serious problems was compared with problems previously found by user testing. The panel completed their evaluations within 1 wk and identified a total of 22 distinct usability problems, 11 of which were considered serious. The problems violated the heuristics of visibility of system status, user control and freedom, match with the real world, intuitive visual layout, consistency and conformity to standards, aesthetic and minimalist design, error prevention and tolerance, and help and documentation. Compared with user testing, heuristic evaluation found most, but not all, of the serious problems. Combining heuristic evaluation and user testing, with each involving a small number of participants, may be an effective and efficient way of improving the usability of e-learning materials. Heuristic evaluation should ideally be used first to identify the most obvious problems and, once these are fixed, should be followed by testing with typical end users.
2013-01-01
Background As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, “Teens Taking Charge: Managing Hemophilia Online,” was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype. Methods A purposive sample (n=18; age 13–18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a “think aloud” usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site. Results Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes. Conclusions Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users. PMID:24094082
Kushniruk, A; Nohr, C; Jensen, S; Borycki, E M
2013-01-01
The objective of this paper is to explore human factors approaches to understanding the use of health information technology (HIT) by extending usability engineering approaches to include analysis of the impact of clinical context through use of clinical simulations. Methods discussed are considered on a continuum from traditional laboratory-based usability testing to clinical simulations. Clinical simulations can be conducted in a simulation laboratory and they can also be conducted in real-world settings. The clinical simulation approach attempts to bring the dimension of clinical context into stronger focus. This involves testing of systems with representative users doing representative tasks, in representative settings/environments. Application of methods where realistic clinical scenarios are used to drive the study of users interacting with systems under realistic conditions and settings can lead to identification of problems and issues with systems that may not be detected using traditional usability engineering methods. In conducting such studies, careful consideration is needed in creating ecologically valid test scenarios. The evidence obtained from such evaluation can be used to improve both the usability and safety of HIT. In addition, recent work has shown that clinical simulations, in particular those conducted in-situ, can lead to considerable benefits when compared to the costs of running such studies. In order to bring context of use into the testing of HIT, clinical simulation, involving observing representative users carrying out tasks in representative settings, holds considerable promise.
Sheehan, Barbara; Lucero, Robert J
2015-01-01
Electronic personal health record-based (ePHR-based) self-management systems can improve patient engagement and have an impact on health outcomes. In order to realize the benefits of these systems, there is a need to develop and evaluate heath information technology from the same theoretical underpinnings. Using an innovative usability approach based in human-centered distributed information design (HCDID), we tested an ePHR-based falls-prevention self-management system-Self-Assessment via a Personal Health Record (i.e., SAPHeR)-designed using HCDID principles in a laboratory. And we later evaluated SAPHeR's use by community-dwelling older adults at home. The innovative approach used in this study supported the analysis of four components: tasks, users, representations, and functions. Tasks were easily learned and features such as text-associated images facilitated task completion. Task performance times were slow, however user satisfaction was high. Nearly seven out of every ten features desired by design participants were evaluated in our usability testing of the SAPHeR system. The in vivo evaluation suggests that older adults could improve their confidence in performing indoor and outdoor activities after using the SAPHeR system. We have applied an innovative consumer-usability evaluation. Our approach addresses the limitations of other usability testing methods that do not utilize consistent theoretically based methods for designing and testing technology. We have successfully demonstrated the utility of testing consumer technology use across multiple components (i.e., task, user, representational, functional) to evaluate the usefulness, usability, and satisfaction of an ePHR-based self-management system.
A Facebook-Based Obesity Prevention Program for Korean American Adolescents: Usability Evaluation.
Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes
Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.
Ratwani, Raj M; Zachary Hettinger, A; Kosydar, Allison; Fairbanks, Rollin J; Hodgkins, Michael L
2017-04-01
Currently, there are few resources for electronic health record (EHR) purchasers and end users to understand the usability processes employed by EHR vendors during product design and development. We developed a framework, based on human factors literature and industry standards, to systematically evaluate the user-centered design processes and usability testing methods used by EHR vendors. We reviewed current usability certification requirements and the human factors literature to develop a 15-point framework for evaluating EHR products. The framework is based on 3 dimensions: user-centered design process, summative testing methodology, and summative testing results. Two vendor usability reports were retrieved from the Office of the National Coordinator's Certified Health IT Product List and were evaluated using the framework. One vendor scored low on the framework (5 pts) while the other vendor scored high on the framework (15 pts). The 2 scored vendor reports demonstrate the framework's ability to discriminate between the variabilities in vendor processes and to determine which vendors are meeting best practices. The framework provides a method to more easily comprehend EHR vendors' usability processes and serves to highlight where EHR vendors may be falling short in terms of best practices. The framework provides a greater level of transparency for both purchasers and end users of EHRs. The framework highlights the need for clearer certification requirements and suggests that the authorized certification bodies that examine vendor usability reports may need to be provided with clearer guidance. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com
Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo
2015-01-01
This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405
Usability Studies and User-Centered Design in Digital Libraries
ERIC Educational Resources Information Center
Comeaux, David J.
2008-01-01
Digital libraries continue to flourish. At the same time, the principles of user-centered design and the practice of usability testing have been growing in popularity, spreading their influence into the library sphere. This article explores the confluence of these two trends by surveying the current literature on usability studies of digital…
Earning the Stamp of Approval: How To Achieve Optimal Usability.
ERIC Educational Resources Information Center
Makar, Susan
2003-01-01
Describes the redesign of the Web site at the virtual library of the NIST (National Institute of Standards and Technology). Discusses usability problems with the original site, including navigation difficulties; focus groups to determine user needs; usability testing for the new Web site; and the importance of customer input. (LRW)
Designing Websites for ESL Learners: A Usability Testing Study
ERIC Educational Resources Information Center
Liu, Min; Traphagan, Tomoko; Huh, Jin; Koh, Young Ihn; Choi, Gilok; McGregor, Allison
2008-01-01
The purpose of this paper is to report on a usability study for ESL websites conducted to gain insights from learners of English as a second language (ESL) as they interacted with specific sites. Five carefully selected ESL sites were tested by 10 different users generating a total of fifty testing sessions. Two major research questions guided the…
Vibration harvesting in traffic tunnels to power wireless sensor nodes
NASA Astrophysics Data System (ADS)
Wischke, M.; Masur, M.; Kröner, M.; Woias, P.
2011-08-01
Monitoring the traffic and the structural health of traffic tunnels requires numerous sensors. Powering these remote and partially embedded sensors from ambient energies will reduce maintenance costs, and improve the sensor network performance. This work reports on vibration levels detected in railway and road tunnels as a potential energy source for embedded sensors. The measurement results showed that the vibrations at any location in the road tunnel and at the wall in the railway tunnel are too small for useful vibration harvesting. In contrast, the railway sleeper features usable vibrations and sufficient mounting space. For this application site, a robust piezoelectric vibration harvester was designed and equipped with a power interface circuit. Within the field test, it is demonstrated that sufficient energy is harvested to supply a microcontroller with a radio frequency (RF) interface.
NASA Astrophysics Data System (ADS)
Stillinger, T.; Dozier, J.; Phares, N.; Rittger, K.
2015-12-01
Discrimination between snow and clouds poses a serious but tractable challenge to the consistent delivery of high-quality information on mountain snow from remote sensing. Clouds obstruct the surface from the sensor's view, and the similar optical properties of clouds and snow make accurate discrimination difficult. We assess the performance of the current Landsat 8 operational snow and cloud mask products (LDCM CCA and CFmask), along with a new method, using over one million manually identified snow and clouds pixels in Landsat 8 scenes. The new method uses physically based scattering models to generate spectra in each Landsat 8 band, at that scene's solar illumination, for snow and cloud particle sizes that cover the plausible range for each. The modeled spectra are compared to pixels' spectra via several independent ways to identify snow and clouds. The results are synthesized to create a final snow/cloud mask, and the method can be applied to any multispectral imager with bands covering the visible, near-infrared, and shortwave-infrared regions. Each algorithm we tested misidentifies snow and clouds in both directions to varying degrees. We assess performance with measures of Precision, Recall, and the F statistic, which are based on counts of true and false positives and negatives. Tests for significance in differences between spectra in the measured and modeled values among incorrectly identified pixels help ascertain reasons for misidentification. A cloud mask specifically designed to separate snow from clouds is a valuable tool for those interested in remotely sensing snow cover. Given freely available remote sensing datasets and computational tools to feasibly process entire mission histories for an area of interest, enabling researchers to reliably identify and separate snow and clouds increases the usability of the data for hydrological and climatological studies.
van Lieshout, Remko; Pisters, Martijn F; Vanwanseele, Benedicte; de Bie, Rob A; Wouters, Eveline J; Stukstette, Mirelle J
2016-01-01
Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient's compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user's perspective. To describe the usability from the physical therapists' and a patients' perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. This study gives insight in the usability of two biofeedback devices from the patient's and physical therapist's perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the patient's perspective. The study findings could help clinicians to decide which biofeedback device is appropriate for their given situation and provide information for future development of biofeedback devices.
User-centered design and usability testing of an innovative health-related quality of life module.
Nagykaldi, Z J; Jordan, M; Quitoriano, J; Ciro, C A; Mold, J W
2014-01-01
Various computerized health risk appraisals (HRAs) are available, but few of them assess health-related quality of life (HRQoL) in a goal-directed framework. This study describes the user-centered development and usability testing of an innovative HRQoL module that extends a validated HRA tool in primary care settings. Systematic user-centered design, usability testing, and qualitative methods were used to develop the HRQoL module in primary care practices. Twenty two patients and 5 clinicians participated in two rounds of interactive technology think-out-loud sessions (TOLs) and semi-structured interviews (SSIs) to iteratively develop a four-step, computerized process that collects information on patient goals for meaningful life activities and current level of disability and presents a personalized and prioritized list of preventive recommendations linked to online resources. Analysis of TOLs and SSIs generated 5 categories and 11 sub-categories related to facilitators and barriers to usability and human-technology interaction. The categories included: Understanding the Purpose, Usability, Perceived Value, Literacy, and Participant Motivation. Some categories were inter-connected. The technology was continually and iteratively improved between sessions until saturation of positive feedback was achieved in 4 categories (addressing motivation will require more research). Usability of all screen units of the module was improved substantially. Clinician feedback emphasized the importance of the module's ability to translate the patient-centered HRQoL Report into actionable items for clinicians to facilitate shared decision-making. Complete integration of the HRQoL module into the existing HRA will require further development and testing. Systematic application of user-centered design and human factors principles in technology development and testing may significantly improve the usability and clinical value of health information systems. This more sophisticated approach helped us translate complex clinical concepts, goal-setting steps, and decision-support processes into an accepted and value-added technology.
Increasing Access and Usability of Remote Sensing Data: The NASA Protected Area Archive
NASA Technical Reports Server (NTRS)
Geller, Gary N.
2004-01-01
Although remote sensing data are now widely available, much of it at low or no-cost, many managers of protected conservation areas do not have the expertise or tools to view or analyze it. Thus access to it by the protected area management community is effectively blocked. The Protected Area Archive will increase access to remote sensing data by creating collections of satellite images of protected areas and packaging them with simple-to-use visualization and analytical tools. The user can easily locate the area and image of interest on a map, then display, roam, and zoom the image. A set of simple tools will be provided so the user can explore the data and employ it to assist in management and monitoring of their area. The 'Phase 1 ' version requires only a Windows-based computer and basic computer skills, and may be of particular help to protected area managers in developing countries.
Melvin, Emilie; Cushing, Anna; Tam, Anne; Kitada, Ruri; Manice, Melissa
2017-01-01
Non-adherence to asthma daily controller medications is a common problem, reported to be responsible for 60% of asthma-related hospitalisations. The mean level of adherence for asthma medications is estimated to be as low as 22%. Therefore, objective measurements of adherence to medicine are necessary. This virtual observational study is designed to measure the usability of an electronic monitoring device platform that measures adherence. Understanding how patients use the BreatheSmart mobile technology at home is essential to assess its feasibility as a solution to improve medication adherence. We anticipate this approach can be applied to real-world environments as a cost-effective solution to improve medication adherence. This is a virtual 6-month observational study of 100 adults (≥18 years) with an asthma diagnosis, using inhaled corticosteroids for at least 3 months. Participants will be recruited in the USA through ad placements online. All participants receive wireless Bluetooth-enabled inhaler sensors that track medication usage and an mSpirometer TM capable of clinical-grade lung function measurements, and download the BreatheSmart mobile application that transmits data to a secure server. All analyses are based on an intention-to-treat. Usability is assessed by patient questionnaires and question sessions. Simple paired t-test is used to assess significant change in Asthma Control Test score, quality of life (EuroQol-5D questionnaire) and lung function. No ethical or safety concerns pertain to the collection of these data. Results of this research are planned to be published as soon as available. NCT03103880.
Usability of online psychoeducation for siblings of people with psychosis.
Sin, Jacqueline; Henderson, Claire; Norman, Ian
2014-10-01
The E Sibling Project aims to address the needs of siblings of individuals affected by psychosis through provision of a comprehensive online intervention. The online intervention comprises four core elements, including: information on psychosis; various coping and promoting well-being strategies; siblings' blogs and discussion forum with peers; and an "Ask the Experts" function. After the intervention-prototype was developed, we tested its feasibility, usability and acceptability by siblings. We evaluated the usability of the intervention-prototype using a non-randomised usability study with siblings of individuals diagnosed with psychosis. The usability study adapted Poulson et al's framework to collect subjective feedback from participants on ease of use, perceived usefulness and acceptability, together with objective usage data on the intervention. Twenty siblings were recruited to the usability test; 19 tried out the resource-prototype over a 4-week period and 17 completed the online evaluation after using the intervention. In total, 906 page-views were made by the participants and each spent about two hours using the resource. Participants evaluated the intervention as helpful, relevant and useful in terms of content, design and usability. Developments are needed to improve the navigation and intuitiveness of the resource. Using an internet-based information-giving and peer support intervention to promote wellbeing and coping is feasible and acceptable to siblings of people with psychosis.
Usability Testing and Analysis Facility (UTAF)
NASA Technical Reports Server (NTRS)
Wong, Douglas T.
2010-01-01
This slide presentation reviews the work of the Usability Testing and Analysis Facility (UTAF) at NASA Johnson Space Center. It is one of the Space Human Factors Laboratories in the Habitability and Human Factors Branch (SF3) at NASA Johnson Space Center The primary focus pf the UTAF is to perform Human factors evaluation and usability testing of crew / vehicle interfaces. The presentation reviews the UTAF expertise and capabilities, the processes and methodologies, and the equipment available. It also reviews the programs that it has supported detailing the human engineering activities in support of the design of the Orion space craft, testing of the EVA integrated spacesuit, and work done for the design of the lunar projects of the Constellation Program: Altair, Lunar Electric Rover, and Outposts
User perspectives on the usability of a regional health information exchange
Ho, Yun-Xian; Cala, Cather Marie; Blakemore, Dana; Chen, Qingxia; Frisse, Mark E; Johnson, Kevin B
2011-01-01
Objective We assessed the usability of a health information exchange (HIE) in a densely populated metropolitan region. This grant-funded HIE had been deployed rapidly to address the imminent needs of the patient population and the need to draw wider participation from regional entities. Design We conducted a cross-sectional survey of individuals given access to the HIE at participating organizations and examined some of the usability and usage factors related to the technology acceptance model. Measurements We probed user perceptions using the Questionnaire for User Interaction Satisfaction, an author-generated Trust scale, and user characteristic questions (eg, age, weekly system usage time). Results Overall, users viewed the system favorably (ratings for all usability items were greater than neutral (one-sample Wilcoxon test, p<0.0014, Bonferroni-corrected for 35 tests). System usage was regressed on usability, trust, and demographic and user characteristic factors. Three usability factors were positively predictive of system usage: overall reactions (p<0 0.01), learning (p<0.05), and system functionality (p<0.01). Although trust is an important component in collaborative relationships, we did not find that user trust of other participating healthcare entities was significantly predictive of usage. An analysis of respondents' comments revealed ways to improve the HIE. Conclusion We used a rapid deployment model to develop an HIE and found that perceptions of system usability were positive. We also found that system usage was predicted well by some aspects of usability. Results from this study suggest that a rapid development approach may serve as a viable model for developing usable HIEs serving communities with limited resources. PMID:21622933
ERIC Educational Resources Information Center
Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo
2008-01-01
This usability study evaluated users' perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption.…
Educational software usability: Artifact or Design?
Van Nuland, Sonya E; Eagleson, Roy; Rogers, Kem A
2017-03-01
Online educational technologies and e-learning tools are providing new opportunities for students to learn worldwide, and they continue to play an important role in anatomical sciences education. Yet, as we shift to teaching online, particularly within the anatomical sciences, it has become apparent that e-learning tool success is based on more than just user satisfaction and preliminary learning outcomes-rather it is a multidimensional construct that should be addressed from an integrated perspective. The efficiency, effectiveness and satisfaction with which a user can navigate an e-learning tool is known as usability, and represents a construct which we propose can be used to quantitatively evaluate e-learning tool success. To assess the usability of an e-learning tool, usability testing should be employed during the design and development phases (i.e., prior to its release to users) as well as during its delivery (i.e., following its release to users). However, both the commercial educational software industry and individual academic developers in the anatomical sciences have overlooked the added value of additional usability testing. Reducing learner frustration and anxiety during e-learning tool use is essential in ensuring e-learning tool success, and will require a commitment on the part of the developers to engage in usability testing during all stages of an e-learning tool's life cycle. Anat Sci Educ 10: 190-199. © 2016 American Association of Anatomists. © 2016 American Association of Anatomists.
Lachance, Christina R; Erby, Lori A H; Ford, Beth M; Allen, Vincent C; Kaphingst, Kimberly A
2010-05-01
As direct-to-consumer genetic testing becomes more available, a diverse group of consumers, including those with limited health literacy, may consider testing. In light of concerns raised about direct-to-consumer genetic testing, this study sought to critically examine whether the informational content, literacy demands, and usability of health-related direct-to-consumer websites met existing recommendations. A content analysis was performed on 29 health-related direct-to-consumer websites. Two coders independently evaluated each website for informational content (e.g., benefits, limitations), literacy demands (e.g., reading level), and usability (e.g., ease of navigation). Most sites presented health conditions and some markers for which they tested, benefits of testing, a description of the testing process, and their privacy policy. Fewer cited scientific literature, explained test limitations, or provided an opportunity to consult a health professional. Key informational content was difficult to locate on most sites. Few sites gave sample disease risk estimates or used common language and explained technical terms consistently. Average reading level was grade 15. The quality of informational content, literacy demands, and usability across health-related direct-to-consumer websites varied widely. Many users would struggle to find and understand the important information. For consumers to better understand the content on these sites and evaluate the meaning of the tests for their health, sites should lower the demands placed on users by distilling and prioritizing the key informational content while simultaneously attending to the reading level and usability elements. In the absence of regulation compelling such changes, government agencies or professional organizations may need to increase consumer and provider awareness of these issues.
Usability study of the EduMod eLearning Program for contouring nodal stations of the head and neck.
Deraniyagala, Rohan; Amdur, Robert J; Boyer, Arthur L; Kaylor, Scott
2015-01-01
A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills. Copyright © 2015 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.
Toombs, Elaine; Unruh, Anita; McGrath, Patrick
2018-01-01
This study aimed to assess the Parent-Adolescent Communication Toolkit, an online intervention designed to help improve parent communication with their adolescents. Participant preferences for two module delivery systems (sequential and unrestricted module access) were identified. Usability assessment of the PACT intervention was completed using pre-test and posttest comparisons. Usability data, including participant completion and satisfaction ratings were examined. Parents ( N = 18) of adolescents were randomized to a sequential or unrestricted chapter access group. Parent participants completed pre-test measures, the PACT intervention and posttest measures. Participants provided feedback for the intervention to improve modules and provided usability ratings. Adolescent pre- and posttest ratings were evaluated. Usability ratings were high and parent feedback was positive. The sequential module access groups rated the intervention content higher and completed more content than the unrestricted chapter access group, indicating support for the sequential access design. Parent mean posttest communication scores were significantly higher ( p < .05) than pre-test scores. No significant differences were detected for adolescent participants. Findings suggest that the Parent-Adolescent Communication Toolkit has potential to improve parent-adolescent communication but further effectiveness assessment is required.
Establishing best practices to improve usability of web interfaces providing atmospheric data
NASA Astrophysics Data System (ADS)
Oakley, N.; Daudert, B.
2014-12-01
Accessing scientific data through an online portal can be a frustrating task. The concept of making web interfaces easy to use known as "usability" has been thoroughly researched in the field of e-commerce but has not been explicitly addressed in the atmospheric sciences. As more observation stations are installed, satellite missions flown, models run, and field campaigns performed, large amounts of data are produced. Portals on the Internet have become the favored mechanisms to share this information and are ever increasing in number. Portals are often created without being tested for usability with the target audience though the expenses of testing are low and the returns high. To remain competitive and relevant in the provision of atmospheric data, it is imperative that developers understand design elements of a successful portal to make their product stand out among others. This presentation informs the audience of the benefits and basic principles of usability for web pages presenting atmospheric data. We will also share some of the best practices and recommendations we have formulated from the results of usability testing performed on two data provision web sites hosted by the Western Regional Climate Center.
Brinkel, J; May, J; Krumkamp, R; Lamshöft, M; Kreuels, B; Owusu-Dabo, E; Mohammed, A; Bonacic Marinovic, A; Dako-Gyeke, P; Krämer, A; Fobil, J N
2017-05-01
To investigate and determine the factors that enhanced or constituted barriers to the acceptance of an mHealth system which was piloted in Asante-Akim North District of Ghana to support healthcare of children. Four semi-structured focus group discussions were conducted with a total of 37 mothers. Participants were selected from a study population of mothers who subscribed to a pilot mHealth system which used an interactive voice response (IVR) for its operations. Data were evaluated using qualitative content analysis methods. In addition, a short quantitative questionnaire assessed system's usability (SUS). Results revealed 10 categories of factors that facilitated user acceptance of the IVR system including quality-of-care experience, health education and empowerment of women. The eight categories of factors identified as barriers to user acceptance included the lack of human interaction, lack of update and training on the electronic advices provided and lack of social integration of the system into the community. The usability (SUS median: 79.3; range: 65-97.5) of the system was rated acceptable. The principles of the tested mHealth system could be of interest during infectious disease outbreaks, such as Ebola or Lassa fever, when there might be a special need for disease-specific health information within populations. © 2017 John Wiley & Sons Ltd.
Usability Testing of Two Ambulatory EHR Navigators.
Hultman, Gretchen; Marquard, Jenna; Arsoniadis, Elliot; Mink, Pamela; Rizvi, Rubina; Ramer, Tim; Khairat, Saif; Fickau, Keri; Melton, Genevieve B
2016-01-01
Despite widespread electronic health record (EHR) adoption, poor EHR system usability continues to be a significant barrier to effective system use for end users. One key to addressing usability problems is to employ user testing and user-centered design. To understand if redesigning an EHR-based navigation tool with clinician input improved user performance and satisfaction. A usability evaluation was conducted to compare two versions of a redesigned ambulatory navigator. Participants completed tasks for five patient cases using the navigators, while employing a think-aloud protocol. The tasks were based on Meaningful Use (MU) requirements. The version of navigator did not affect perceived workload, and time to complete tasks was longer in the redesigned navigator. A relatively small portion of navigator content was used to complete the MU-related tasks, though navigation patterns were highly variable across participants for both navigators. Preferences for EHR navigation structures appeared to be individualized. This study demonstrates the importance of EHR usability assessments to evaluate group and individual performance of different interfaces and preferences for each design.
McGillion, Michael; Yost, Jennifer; Turner, Andrew; Bender, Duane; Scott, Ted; Carroll, Sandra; Ritvo, Paul; Peter, Elizabeth; Lamy, Andre; Furze, Gill; Krull, Kirsten; Dunlop, Valerie; Good, Amber; Dvirnik, Nazari; Bedini, Debbie; Naus, Frank; Pettit, Shirley; Henry, Shaunattonie; Probst, Christine; Mills, Joseph; Gossage, Elaine; Travale, Irene; Duquette, Janine; Taberner, Christy; Bhavnani, Sanjeev; Khan, James S; Cowan, David; Romeril, Eric; Lee, John; Colella, Tracey; Choinière, Manon; Busse, Jason; Katz, Joel; Victor, J Charles; Hoch, Jeffrey; Isaranuwatchai, Wanrudee; Kaasalainen, Sharon; Ladak, Salima; O'Keefe-McCarthy, Sheila; Parry, Monica; Sessler, Daniel I; Stacey, Michael; Stevens, Bonnie; Stremler, Robyn; Thabane, Lehana; Watt-Watson, Judy; Whitlock, Richard; MacDermid, Joy C; Leegaard, Marit; McKelvie, Robert; Hillmer, Michael; Cooper, Lynn; Arthur, Gavin; Sider, Krista; Oliver, Susan; Boyajian, Karen; Farrow, Mark; Lawton, Chris; Gamble, Darryl; Walsh, Jake; Field, Mark; LeFort, Sandra; Clyne, Wendy; Ricupero, Maria; Poole, Laurie; Russell-Wood, Karsten; Weber, Michael; McNeil, Jolene; Alpert, Robyn; Sharpe, Sarah; Bhella, Sue; Mohajer, David; Ponnambalam, Sem; Lakhani, Naeem; Khan, Rabia; Liu, Peter; Devereaux, P J
2016-08-01
Tens of thousands of cardiac and vascular surgeries (CaVS) are performed on seniors in Canada and the United Kingdom each year to improve survival, relieve disease symptoms, and improve health-related quality of life (HRQL). However, chronic postsurgical pain (CPSP), undetected or delayed detection of hemodynamic compromise, complications, and related poor functional status are major problems for substantial numbers of patients during the recovery process. To tackle this problem, we aim to refine and test the effectiveness of an eHealth-enabled service delivery intervention, TecHnology-Enabled remote monitoring and Self-MAnagemenT-VIsion for patient EmpoWerment following Cardiac and VasculaR surgery (THE SMArTVIEW, CoVeRed), which combines remote monitoring, education, and self-management training to optimize recovery outcomes and experience of seniors undergoing CaVS in Canada and the United Kingdom. Our objectives are to (1) refine SMArTVIEW via high-fidelity user testing and (2) examine the effectiveness of SMArTVIEW via a randomized controlled trial (RCT). CaVS patients and clinicians will engage in two cycles of focus groups and usability testing at each site; feedback will be elicited about expectations and experience of SMArTVIEW, in context. The data will be used to refine the SMArTVIEW eHealth delivery program. Upon transfer to the surgical ward (ie, post-intensive care unit [ICU]), 256 CaVS patients will be reassessed postoperatively and randomly allocated via an interactive Web randomization system to the intervention group or usual care. The SMArTVIEW intervention will run from surgical ward day 2 until 8 weeks following surgery. Outcome assessments will occur on postoperative day 30; at week 8; and at 3, 6, 9, and 12 months. The primary outcome is worst postop pain intensity upon movement in the previous 24 hours (Brief Pain Inventory-Short Form), averaged across the previous 14 days. Secondary outcomes include a composite of postoperative complications related to hemodynamic compromise-death, myocardial infarction, and nonfatal stroke- all-cause mortality and surgical site infections, functional status (Medical Outcomes Study Short Form-12), depressive symptoms (Geriatric Depression Scale), health service utilization-related costs (health service utilization data from the Institute for Clinical Evaluative Sciences data repository), and patient-level cost of recovery (Ambulatory Home Care Record). A linear mixed model will be used to assess the effects of the intervention on the primary outcome, with an a priori contrast of weekly average worst pain intensity upon movement to evaluate the primary endpoint of pain at 8 weeks postoperation. We will also examine the incremental cost of the intervention compared to usual care using a regression model to estimate the difference in expected health care costs between groups. Study start-up is underway and usability testing is scheduled to begin in the fall of 2016. Given our experience, dedicated industry partners, and related RCT infrastructure, we are confident we can make a lasting contribution to improving the care of seniors who undergo CaVS.
Yost, Jennifer; Turner, Andrew; Bender, Duane; Scott, Ted; Carroll, Sandra; Ritvo, Paul; Peter, Elizabeth; Lamy, Andre; Furze, Gill; Krull, Kirsten; Dunlop, Valerie; Good, Amber; Dvirnik, Nazari; Bedini, Debbie; Naus, Frank; Pettit, Shirley; Henry, Shaunattonie; Probst, Christine; Mills, Joseph; Gossage, Elaine; Travale, Irene; Duquette, Janine; Taberner, Christy; Bhavnani, Sanjeev; Khan, James S; Cowan, David; Romeril, Eric; Lee, John; Colella, Tracey; Choinière, Manon; Busse, Jason; Katz, Joel; Victor, J Charles; Hoch, Jeffrey; Isaranuwatchai, Wanrudee; Kaasalainen, Sharon; Ladak, Salima; O'Keefe-McCarthy, Sheila; Parry, Monica; Sessler, Daniel I; Stacey, Michael; Stevens, Bonnie; Stremler, Robyn; Thabane, Lehana; Watt-Watson, Judy; Whitlock, Richard; MacDermid, Joy C; Leegaard, Marit; McKelvie, Robert; Hillmer, Michael; Cooper, Lynn; Arthur, Gavin; Sider, Krista; Oliver, Susan; Boyajian, Karen; Farrow, Mark; Lawton, Chris; Gamble, Darryl; Walsh, Jake; Field, Mark; LeFort, Sandra; Clyne, Wendy; Ricupero, Maria; Poole, Laurie; Russell-Wood, Karsten; Weber, Michael; McNeil, Jolene; Alpert, Robyn; Sharpe, Sarah; Bhella, Sue; Mohajer, David; Ponnambalam, Sem; Lakhani, Naeem; Khan, Rabia; Liu, Peter
2016-01-01
Background Tens of thousands of cardiac and vascular surgeries (CaVS) are performed on seniors in Canada and the United Kingdom each year to improve survival, relieve disease symptoms, and improve health-related quality of life (HRQL). However, chronic postsurgical pain (CPSP), undetected or delayed detection of hemodynamic compromise, complications, and related poor functional status are major problems for substantial numbers of patients during the recovery process. To tackle this problem, we aim to refine and test the effectiveness of an eHealth-enabled service delivery intervention, TecHnology-Enabled remote monitoring and Self-MAnagemenT—VIsion for patient EmpoWerment following Cardiac and VasculaR surgery (THE SMArTVIEW, CoVeRed), which combines remote monitoring, education, and self-management training to optimize recovery outcomes and experience of seniors undergoing CaVS in Canada and the United Kingdom. Objective Our objectives are to (1) refine SMArTVIEW via high-fidelity user testing and (2) examine the effectiveness of SMArTVIEW via a randomized controlled trial (RCT). Methods CaVS patients and clinicians will engage in two cycles of focus groups and usability testing at each site; feedback will be elicited about expectations and experience of SMArTVIEW, in context. The data will be used to refine the SMArTVIEW eHealth delivery program. Upon transfer to the surgical ward (ie, post-intensive care unit [ICU]), 256 CaVS patients will be reassessed postoperatively and randomly allocated via an interactive Web randomization system to the intervention group or usual care. The SMArTVIEW intervention will run from surgical ward day 2 until 8 weeks following surgery. Outcome assessments will occur on postoperative day 30; at week 8; and at 3, 6, 9, and 12 months. The primary outcome is worst postop pain intensity upon movement in the previous 24 hours (Brief Pain Inventory-Short Form), averaged across the previous 14 days. Secondary outcomes include a composite of postoperative complications related to hemodynamic compromise—death, myocardial infarction, and nonfatal stroke— all-cause mortality and surgical site infections, functional status (Medical Outcomes Study Short Form-12), depressive symptoms (Geriatric Depression Scale), health service utilization-related costs (health service utilization data from the Institute for Clinical Evaluative Sciences data repository), and patient-level cost of recovery (Ambulatory Home Care Record). A linear mixed model will be used to assess the effects of the intervention on the primary outcome, with an a priori contrast of weekly average worst pain intensity upon movement to evaluate the primary endpoint of pain at 8 weeks postoperation. We will also examine the incremental cost of the intervention compared to usual care using a regression model to estimate the difference in expected health care costs between groups. Results Study start-up is underway and usability testing is scheduled to begin in the fall of 2016. Conclusions Given our experience, dedicated industry partners, and related RCT infrastructure, we are confident we can make a lasting contribution to improving the care of seniors who undergo CaVS. PMID:27480247
Kushniruk, A; Kaipio, J; Nieminen, M; Hyppönen, H; Lääveri, T; Nohr, C; Kanstrup, A M; Berg Christiansen, M; Kuo, M-H; Borycki, E
2014-08-15
The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems.
Kaipio, J.; Nieminen, M.; Hyppönen, H.; Lääveri, T.; Nohr, C.; Kanstrup, A. M.; Berg Christiansen, M.; Kuo, M.-H.; Borycki, E.
2014-01-01
Summary Objectives The objective of this paper is to explore approaches to understanding the usability of health information systems at regional and national levels. Methods Several different methods are discussed in case studies from Denmark, Finland and Canada. They range from small scale qualitative studies involving usability testing of systems to larger scale national level questionnaire studies aimed at assessing the use and usability of health information systems by entire groups of health professionals. Results It was found that regional and national usability studies can complement smaller scale usability studies, and that they are needed in order to understand larger trends regarding system usability. Despite adoption of EHRs, many health professionals rate the usability of the systems as low. A range of usability issues have been noted when data is collected on a large scale through use of widely distributed questionnaires and websites designed to monitor user perceptions of usability. Conclusion As health information systems are deployed on a widespread basis, studies that examine systems used regionally or nationally are required. In addition, collection of large scale data on the usability of specific IT products is needed in order to complement smaller scale studies of specific systems. PMID:25123725
Peute, Linda W P; de Keizer, Nicolette F; Jaspers, Monique W M
2015-06-01
To compare the performance of the Concurrent (CTA) and Retrospective (RTA) Think Aloud method and to assess their value in a formative usability evaluation of an Intensive Care Registry-physician data query tool designed to support ICU quality improvement processes. Sixteen representative intensive care physicians participated in the usability evaluation study. Subjects were allocated to either the CTA or RTA method by a matched randomized design. Each subject performed six usability-testing tasks of varying complexity in the query tool in a real-working context. Methods were compared with regard to number and type of problems detected. Verbal protocols of CTA and RTA were analyzed in depth to assess differences in verbal output. Standardized measures were applied to assess thoroughness in usability problem detection weighted per problem severity level and method overall effectiveness in detecting usability problems with regard to the time subjects spent per method. The usability evaluation of the data query tool revealed a total of 43 unique usability problems that the intensive care physicians encountered. CTA detected unique usability problems with regard to graphics/symbols, navigation issues, error messages, and the organization of information on the query tool's screens. RTA detected unique issues concerning system match with subjects' language and applied terminology. The in-depth verbal protocol analysis of CTA provided information on intensive care physicians' query design strategies. Overall, CTA performed significantly better than RTA in detecting usability problems. CTA usability problem detection effectiveness was 0.80 vs. 0.62 (p<0.05) respectively, with an average difference of 42% less time spent per subject compared to RTA. In addition, CTA was more thorough in detecting usability problems of a moderate (0.85 vs. 0.7) and severe nature (0.71 vs. 0.57). In this study, the CTA is more effective in usability-problem detection and provided clarification of intensive care physician query design strategies to inform redesign of the query tool. However, CTA does not outperform RTA. The RTA additionally elucidated unique usability problems and new user requirements. Based on the results of this study, we recommend the use of CTA in formative usability evaluation studies of health information technology. However, we recommend further research on the application of RTA in usability studies with regard to user expertise and experience when focusing on user profile customized (re)design. Copyright © 2015 Elsevier Inc. All rights reserved.
Facilitating Energy Savings through Enhanced Usability of Thermostats
DOE Office of Scientific and Technical Information (OSTI.GOV)
Meier, Alan; Aragon, Cecilia; Peffer, Therese
2011-05-23
Residential thermostats play a key role in controlling heating and cooling systems. Occupants often find the controls of programmable thermostats confusing, sometimes leading to higher heating consumption than when the buildings are controlled manually. A high degree of usability is vital to a programmable thermostat's effectiveness because, unlike a more efficient heating system, occupants must engage in specific actions after installation to obtain energy savings. We developed a procedure for measuring the usability of thermostats and tested this methodology with 31 subjects on five thermostats. The procedure requires first identifying representative tasks associated with the device and then testing themore » subjects ability to accomplish those tasks. The procedure was able to demonstrate the subjects wide ability to accomplish tasks and the influence of a device's usability on success rates. A metric based on the time to accomplish the tasks and the fraction of subjects actually completing the tasks captured the key aspects of each thermostat's usability. The procedure was recently adopted by the Energy Star Program for its thermostat specification. The approach appears suitable for quantifying usability of controls in other products, such as heat pump water heaters and commercial lighting.« less
Tang, Jonathan; Mandrusiak, Allison; Russell, Trevor
2012-01-01
Pulmonary rehabilitation is an effective treatment for people with chronic obstructive pulmonary disease. However, access to these services is limited especially in rural and remote areas. Telerehabilitation has the potential to deliver pulmonary rehabilitation programs to these communities. The aim of this study was threefold: to establish the technical feasibility of transmitting real-time pulse oximetry data, determine the validity of remote measurements compared to conventional face-to-face measures, and evaluate the participants' perception of the usability of the technology. Thirty-seven healthy individuals participated in a single remote pulmonary rehabilitation exercise session, conducted using the eHAB telerehabilitation system. Validity was assessed by comparing the participant's oxygen saturation and heart rate with the data set received at the therapist's remote location. There was an 80% exact agreement between participant and therapist data sets. The mean absolute difference and Bland and Altman's limits of agreement fell within the minimum clinically important difference for both oxygen saturation and heart rate values. Participants found the system easy to use and felt confident that they would be able to use it at home. Remote measurement of pulse oximetry data for a pulmonary rehabilitation exercise session was feasible and valid when compared to conventional face-to-face methods. PMID:23049549
Remote sensing, hydrological modeling and in situ observations in snow cover research: A review
NASA Astrophysics Data System (ADS)
Dong, Chunyu
2018-06-01
Snow is an important component of the hydrological cycle. As a major part of the cryosphere, snow cover also represents a valuable terrestrial water resource. In the context of climate change, the dynamics of snow cover play a crucial role in rebalancing the global energy and water budgets. Remote sensing, hydrological modeling and in situ observations are three techniques frequently utilized for snow cover investigations. However, the uncertainties caused by systematic errors, scale gaps, and complicated snow physics, among other factors, limit the usability of these three approaches in snow studies. In this paper, an overview of the advantages, limitations and recent progress of the three methods is presented, and more effective ways to estimate snow cover properties are evaluated. The possibility of improving remotely sensed snow information using ground-based observations is discussed. As a rapidly growing source of volunteered geographic information (VGI), web-based geotagged photos have great potential to provide ground truth data for remotely sensed products and hydrological models and thus contribute to procedures for cloud removal, correction, validation, forcing and assimilation. Finally, this review proposes a synergistic framework for the future of snow cover research. This framework highlights the cross-scale integration of in situ and remotely sensed snow measurements and the assimilation of improved remote sensing data into hydrological models.
Serchi, V; Peruzzi, A; Cereatti, A; Della Croce, U
2016-01-01
The knowledge of the visual strategies adopted while walking in cognitively engaging environments is extremely valuable. Analyzing gaze when a treadmill and a virtual reality environment are used as motor rehabilitation tools is therefore critical. Being completely unobtrusive, remote eye-trackers are the most appropriate way to measure the point of gaze. Still, the point of gaze measurements are affected by experimental conditions such as head range of motion and visual stimuli. This study assesses the usability limits and measurement reliability of a remote eye-tracker during treadmill walking while visual stimuli are projected. During treadmill walking, the head remained within the remote eye-tracker workspace. Generally, the quality of the point of gaze measurements declined as the distance from the remote eye-tracker increased and data loss occurred for large gaze angles. The stimulus location (a dot-target) did not influence the point of gaze accuracy, precision, and trackability during both standing and walking. Similar results were obtained when the dot-target was replaced by a static or moving 2D target and "region of interest" analysis was applied. These findings foster the feasibility of the use of a remote eye-tracker for the analysis of gaze during treadmill walking in virtual reality environments.
A Remote PLC Laboratory (RLab) for Distance Practical Work of Industrial Automation
NASA Astrophysics Data System (ADS)
Haritman, E.; Somantri, Y.; Wahyudin, D.; Mulyana, E.
2018-02-01
A laboratory is an essential equipment for engineering students to do a useful practical work. Therefore, universities should provide an adequate facility for practical work. On the other hand, industrial automation laboratory would offer students beneficial experience by using various educational PLC kits. This paper describes the development of Web-based Programmable Logic Controller (PLC) remote laboratory called RLab. It provides an environment for learners to study PLC application to control the level of the non-interacting tank. The RLab architecture is based on a Moodle and Remote Desktop, which also manages the booking system of the schedule of practical work in the laboratory. The RLab equipped by USB cameras providing a real-time view of PLC environment. To provide a secured system, the RLab combines Moodle and Remote Desktop application for the authentication system and management of remote users. Moodle will send PartnerID and password to connect to TeamViewer. It has been examined that the laboratory requirement, time and flexibility restrictions constitute a significant obstacle facing traditional students desiring to finish the course. A remote access laboratory can be eliminating time and flexibility restrictions. The preliminary study of RLab usability proved that such system is adequate to give the learners a distance practical work environment.
Telerehabilitation Technologies: Accessibility and Usability
Pramuka, Michael; van Roosmalen, Linda
2009-01-01
In the fields of telehealth and telemedicine, phone and/or video technologies are key to the successful provision of services such as remote monitoring and visits. How do these technologies affect service accessibility, effectiveness, quality, and usefulness when applied to rehabilitation services in the field of telerehabilitation? To answer this question, we provide a overview of the complex network of available technologies and discuss how they link to rehabilitation applications, services, and practices as well as to the telerehabilitation end-user. This white paper will first present the numerous professional considerations that shape the use of technology in telerehabilitation service and set it somewhat apart from telemedicine. It will then provide an overview of concepts essential to usability analysis; present a summary of various telerehabilitation technologies and their strengths and limitations, and consider how the technologies interface with end users’ clinical needs for service accessibility, effectiveness, quality, and usefulness. The paper will highlight a conceptual framework (including task analyses and usability issues) that underlies a functional match between telerehabilitation technologies, clinical applications, and end-user capabilities for telerehabilitation purposes. Finally, we will discuss pragmatic issues related to user integration of telerehabilitation technology versus traditional face-to-face approaches. PMID:25945165
50 Mb/s, 220-mW Laser-Array Transmitter
NASA Technical Reports Server (NTRS)
Cornwell, Donald M., Jr.
1992-01-01
Laser transmitter based on injection locking produces single-wavelength, diffraction-limited, single-lobe beam. Output stage is array of laser diodes producing non-diffraction-limited, multi-mode beam in absence of injection locking. Suitable for both free-space and optical-fiber communication systems. Because beam from transmitter focused to spot as small as 5 micrometers, devices usable for reading and writing optical disks at increased information densities. Application also in remote sensing and ranging.
Card-Sorting Usability Tests of the WMU Libraries' Web Site
ERIC Educational Resources Information Center
Whang, Michael
2008-01-01
This article describes the card-sorting techniques used by several academic libraries, reports and discusses the results of card-sorting usability tests of the Western Michigan University Libraries' Web site, and reveals how the WMU libraries incorporated the findings into a new Web site redesign, setting the design direction early on. The article…
The Portable Usability Testing Lab: A Flexible Research Tool.
ERIC Educational Resources Information Center
Hale, Michael E.; And Others
A group of faculty at the University of Georgia obtained funding for a research and development facility called the Learning and Performance Support Laboratory (LPSL). One of the LPSL's primary needs was obtaining a portable usability lab for software testing, so the facility obtained the "Luggage Lab 2000." The lab is transportable to…
Sorbello, Alfred; Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier
2017-03-22
We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers' capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. All usability test participants cited the tool's ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool's automated literature search relative to a manual 'all fields' PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction.
Barbara, Angela M; Dobbins, Maureen; Haynes, R Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder; Levinson, Anthony J
2016-05-11
Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal's strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites.
Dobbins, Maureen; Haynes, R. Brian; Iorio, Alfonso; Lavis, John N; Raina, Parminder
2016-01-01
Background Increasingly, older adults and their informal caregivers are using the Internet to search for health-related information. There is a proliferation of health information online, but the quality of this information varies, often based on exaggerated or dramatic findings, and not easily comprehended by consumers. The McMaster Optimal Aging Portal (Portal) was developed to provide Internet users with high-quality evidence about aging and address some of these current limitations of health information posted online. The Portal includes content for health professionals coming from three best-in-class resources (MacPLUS, Health Evidence, and Health Systems Evidence) and four types of content specifically prepared for the general public (Evidence Summaries, Web Resource Ratings, Blog Posts, and Twitter messages). Objective Our objectives were to share the findings of the usability evaluation of the Portal with particular focus on the content features for the general public and to inform designers of health information websites and online resources for older adults about key usability themes. Methods Data analysis included task performance during usability testing and qualitative content analyses of both the usability sessions and interviews to identify core themes. Results A total of 37 participants took part in 33 usability testing sessions and 21 focused interviews. Qualitative analysis revealed common themes regarding the Portal’s strengths and challenges to usability. The strengths of the website were related to credibility, applicability, browsing function, design, and accessibility. The usability challenges included reluctance to register, process of registering, searching, terminology, and technical features. Conclusions The study reinforced the importance of including end users during the development of this unique, dynamic, evidence-based health information website. The feedback was applied to iteratively improve website usability. Our findings can be applied by designers of health-related websites. PMID:27170443
Automated image processing of LANDSAT 2 digital data for watershed runoff prediction
NASA Technical Reports Server (NTRS)
Sasso, R. R.; Jensen, J. R.; Estes, J. E.
1977-01-01
The U.S. Soil Conservation Service (SCS) model for watershed runoff prediction uses soil and land cover information as its major drivers. Kern County Water Agency is implementing the SCS model to predict runoff for 10,400 sq cm of mountainous watershed in Kern County, California. The Remote Sensing Unit, University of California, Santa Barbara, was commissioned by KCWA to conduct a 230 sq cm feasibility study in the Lake Isabella, California region to evaluate remote sensing methodologies which could be ultimately extrapolated to the entire 10,400 sq cm Kern County watershed. Digital results indicate that digital image processing of Landsat 2 data will provide usable land cover required by KCWA for input to the SCS runoff model.
Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J
2015-01-01
Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. PMID:25933798
PyMercury: Interactive Python for the Mercury Monte Carlo Particle Transport Code
DOE Office of Scientific and Technical Information (OSTI.GOV)
Iandola, F N; O'Brien, M J; Procassini, R J
2010-11-29
Monte Carlo particle transport applications are often written in low-level languages (C/C++) for optimal performance on clusters and supercomputers. However, this development approach often sacrifices straightforward usability and testing in the interest of fast application performance. To improve usability, some high-performance computing applications employ mixed-language programming with high-level and low-level languages. In this study, we consider the benefits of incorporating an interactive Python interface into a Monte Carlo application. With PyMercury, a new Python extension to the Mercury general-purpose Monte Carlo particle transport code, we improve application usability without diminishing performance. In two case studies, we illustrate how PyMercury improvesmore » usability and simplifies testing and validation in a Monte Carlo application. In short, PyMercury demonstrates the value of interactive Python for Monte Carlo particle transport applications. In the future, we expect interactive Python to play an increasingly significant role in Monte Carlo usage and testing.« less
Usability testing of an mHealth device for swallowing therapy in head and neck cancer survivors.
Constantinescu, Gabriela; Kuffel, Kristina; King, Ben; Hodgetts, William; Rieger, Jana
2018-04-01
The objective of this study was to conduct the first patient usability testing of a mobile health (mHealth) system for in-home swallowing therapy. Five participants with a history of head and neck cancer evaluated the mHealth system. After completing an in-application (app) tutorial with the clinician, participants were asked to independently complete five tasks: pair the device to the smartphone, place the device correctly, exercise, interpret progress displays, and close the system. Quantitative and qualitative methods were used to evaluate the effectiveness, efficiency, and satisfaction with the system. Critical changes to the app were found in three of the tasks, resulting in recommendations for the next iteration. These issues were related to ease of Bluetooth pairing, placement of device, and interpretation of statistics. Usability testing with patients identified issues that were essential to address prior to implementing the mHealth system in subsequent clinical trials. Of the usability methods used, video observation (synced screen capture with videoed gestures) revealed the most information.
Interactive Digital e-Health Game for Heart Failure Self-Management: A Feasibility Study.
Radhakrishnan, Kavita; Toprac, Paul; O'Hair, Matt; Bias, Randolph; Kim, Miyong T; Bradley, Paul; Mackert, Michael
2016-12-01
To develop and test the prototype of a serious digital game for improving community-dwelling older adults' heart failure (HF) knowledge and self-management behaviors. The serious game innovatively incorporates evidence-based HF guidelines with contemporary game technology. The study included three phases: development of the game prototype, its usability assessment, and evaluation of the game's functionality. Usability testing included researchers' usability assessment, followed by research personnel's observations of participants playing the game, and participants' completion of a usability survey. Next, in a pretest-post-test design, validated instruments-the Atlanta Heart Failure Knowledge Test and the Self Care for Heart Failure Index-were used to measure improvement in HF self-management knowledge and behaviors related to HF self-maintenance, self-management, and self-efficacy, respectively. A postgame survey assessed participants' perceptions of the game. During usability testing, with seven participants, 100%, 100%, and 86% found the game easy to play, enjoyable, and helpful for learning about HF, respectively. In the subsequent functionality testing, with 19 participants, 89% found the game interesting, enjoyable, and easy to play. Playing the game resulted in a significant improvement in HF self-management knowledge, a nonsignificant improvement in self-reported behaviors related to HF self-maintenance, and no difference in HF self-efficacy scores. Participants with lower education level and age preferred games to any other medium for receiving information. It is feasible to develop a serious digital game that community-dwelling older adults with HF find both satisfying and acceptable and that can improve their self-management knowledge.
Interactive Digital e-Health Game for Heart Failure Self-Management: A Feasibility Study
Toprac, Paul; O'Hair, Matt; Bias, Randolph; Kim, Miyong T.; Bradley, Paul; Mackert, Michael
2016-01-01
Abstract Objective: To develop and test the prototype of a serious digital game for improving community-dwelling older adults' heart failure (HF) knowledge and self-management behaviors. The serious game innovatively incorporates evidence-based HF guidelines with contemporary game technology. Materials and Methods: The study included three phases: development of the game prototype, its usability assessment, and evaluation of the game's functionality. Usability testing included researchers' usability assessment, followed by research personnel's observations of participants playing the game, and participants' completion of a usability survey. Next, in a pretest–post-test design, validated instruments—the Atlanta Heart Failure Knowledge Test and the Self Care for Heart Failure Index—were used to measure improvement in HF self-management knowledge and behaviors related to HF self-maintenance, self-management, and self-efficacy, respectively. A postgame survey assessed participants' perceptions of the game. Results: During usability testing, with seven participants, 100%, 100%, and 86% found the game easy to play, enjoyable, and helpful for learning about HF, respectively. In the subsequent functionality testing, with 19 participants, 89% found the game interesting, enjoyable, and easy to play. Playing the game resulted in a significant improvement in HF self-management knowledge, a nonsignificant improvement in self-reported behaviors related to HF self-maintenance, and no difference in HF self-efficacy scores. Participants with lower education level and age preferred games to any other medium for receiving information. Conclusion: It is feasible to develop a serious digital game that community-dwelling older adults with HF find both satisfying and acceptable and that can improve their self-management knowledge. PMID:27976955
U.S. Geological Survey, remote sensing, and geoscience data: Using standards to serve us all
Benson, Michael G.; Faundeen, John L.
2000-01-01
The U.S. Geological Survey (USGS) advocates the use of standards with geosciences and remotely sensed data and metadata for its own purposes and those of its customers. In activities that range from archiving data to making a product, the incorporation of standards makes these functions repeatable and understandable. More important, when accepted standards are followed, data discovery and sharing can be more efficient and the overall value to society can be expanded. The USGS archives many terabytes of digital geoscience and remotely sensed data. Several million photographs are also available to the research community. To manage these vast holdings and ensure that strict preservation and high usability criteria are observed, the USGS uses standards within the archival, data management, public access and ordering, and data distribution areas. The USGS uses Federal and international standards in performing its role as the U.S. National Satellite Land Remote Sensing Data Archive and in its mission as the long-term archive and production center for aerial photographs and cartographic data covering the United States.
Advances in U.S. Land Imaging Capabilities
NASA Astrophysics Data System (ADS)
Stryker, T. S.
2017-12-01
Advancements in Earth observations, cloud computing, and data science are improving everyday life. Information from land-imaging satellites, such as the U.S. Landsat system, helps us to better understand the changing landscapes where we live, work, and play. This understanding builds capacity for improved decision-making about our lands, waters, and resources, driving economic growth, protecting lives and property, and safeguarding the environment. The USGS is fostering the use of land remote sensing technology to meet local, national, and global challenges. A key dimension to meeting these challenges is the full, free, and open provision of land remote sensing observations for both public and private sector applications. To achieve maximum impact, these data must also be easily discoverable, accessible, and usable. The presenter will describe the USGS Land Remote Sensing Program's current capabilities and future plans to collect and deliver land remote sensing information for societal benefit. He will discuss these capabilities in the context of national plans and policies, domestic partnerships, and international collaboration. The presenter will conclude with examples of how Landsat data is being used on a daily basis to improve lives and livelihoods.
A Wide-field Camera and Fully Remote Operations at the Wyoming Infrared Observatory
NASA Astrophysics Data System (ADS)
Findlay, Joseph R.; Kobulnicky, Henry A.; Weger, James S.; Bucher, Gerald A.; Perry, Marvin C.; Myers, Adam D.; Pierce, Michael J.; Vogel, Conrad
2016-11-01
Upgrades at the 2.3 meter Wyoming Infrared Observatory telescope have provided the capability for fully remote operations by a single operator from the University of Wyoming campus. A line-of-sight 300 Megabit s-1 11 GHz radio link provides high-speed internet for data transfer and remote operations that include several realtime video feeds. Uninterruptable power is ensured by a 10 kVA battery supply for critical systems and a 55 kW autostart diesel generator capable of running the entire observatory for up to a week. The construction of a new four-element prime-focus corrector with fused-silica elements allows imaging over a 40‧ field of view with a new 40962 UV-sensitive prime-focus camera and filter wheel. A new telescope control system facilitates the remote operations model and provides 20″ rms pointing over the usable sky. Taken together, these improvements pave the way for a new generation of sky surveys supporting space-based missions and flexible-cadence observations advancing emerging astrophysical priorities such as planet detection, quasar variability, and long-term time-domain campaigns.
De Cocker, K; Charlier, C; Van Hoof, E; Pauwels, E; Lechner, L; Bourgois, J; Spittaels, H; Vandelanotte, C; De Bourdeaudhuij, I
2015-09-01
This observational study aimed to adapt a computer-tailored step advice for the general population into a feasible advice for breast cancer survivors and to test its usability. First, several adaptations were made to the original design (adding cancer-related physical activity (PA) barriers and beliefs, and self-management strategies to improve survivors' personal control). Second, the adapted advice was evaluated in two phases: (1) a usability testing in healthy women (n = 3) and survivors (n = 6); and (2) a process evaluation during 3 weeks in breast cancer survivors (n = 8). Preliminary usability testing revealed no problems during logging-in; however, three survivors misinterpreted some questions. After refining the questionnaire and advice, survivors evaluated the advice as interesting, attractive to read, comprehensible and credible. Inactive survivors found the advice novel, but too long. The process evaluation indicated that the majority of the women (n = 5/8) reported increased steps. Monitoring step counts by using a pedometer was perceived as an important motivator to be more active. To conclude, this study provides initial support for the usability and acceptability of a computer-tailored pedometer-based PA advice for breast cancer survivors. After testing efficacy and effectiveness of this intervention, this tool can broaden the reach of PA promotion in breast cancer survivors. © 2014 John Wiley & Sons Ltd.
An optimized web-based approach for collaborative stereoscopic medical visualization
Kaspar, Mathias; Parsad, Nigel M; Silverstein, Jonathan C
2013-01-01
Objective Medical visualization tools have traditionally been constrained to tethered imaging workstations or proprietary client viewers, typically part of hospital radiology systems. To improve accessibility to real-time, remote, interactive, stereoscopic visualization and to enable collaboration among multiple viewing locations, we developed an open source approach requiring only a standard web browser with no added client-side software. Materials and Methods Our collaborative, web-based, stereoscopic, visualization system, CoWebViz, has been used successfully for the past 2 years at the University of Chicago to teach immersive virtual anatomy classes. It is a server application that streams server-side visualization applications to client front-ends, comprised solely of a standard web browser with no added software. Results We describe optimization considerations, usability, and performance results, which make CoWebViz practical for broad clinical use. We clarify technical advances including: enhanced threaded architecture, optimized visualization distribution algorithms, a wide range of supported stereoscopic presentation technologies, and the salient theoretical and empirical network parameters that affect our web-based visualization approach. Discussion The implementations demonstrate usability and performance benefits of a simple web-based approach for complex clinical visualization scenarios. Using this approach overcomes technical challenges that require third-party web browser plug-ins, resulting in the most lightweight client. Conclusions Compared to special software and hardware deployments, unmodified web browsers enhance remote user accessibility to interactive medical visualization. Whereas local hardware and software deployments may provide better interactivity than remote applications, our implementation demonstrates that a simplified, stable, client approach using standard web browsers is sufficient for high quality three-dimensional, stereoscopic, collaborative and interactive visualization. PMID:23048008
Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis.
Ferron, Joelle C; Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J
2017-03-03
Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly-66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. ©Joelle C Ferron, Mary F Brunette, Pamela Geiger, Lisa A Marsch, Anna M Adachi-Mejia, Stephen J Bartels. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 03.03.2017.
Mobile Phone Apps for Smoking Cessation: Quality and Usability Among Smokers With Psychosis
Brunette, Mary F; Geiger, Pamela; Marsch, Lisa A; Adachi-Mejia, Anna M; Bartels, Stephen J
2017-01-01
Background Smoking is one of the top preventable causes of mortality in people with psychotic disorders such as schizophrenia. Cessation treatment improves abstinence outcomes, but access is a barrier. Mobile phone apps are one way to increase access to cessation treatment; however, whether they are usable by people with psychotic disorders, who often have special learning needs, is not known. Objective Researchers reviewed 100 randomly selected apps for smoking cessation to rate them based on US guidelines for nicotine addiction treatment and to categorize them based on app functions. We aimed to test the usability and usefulness of the top-rated apps in 21 smokers with psychotic disorders. Methods We identified 766 smoking cessation apps and randomly selected 100 for review. Two independent reviewers rated each app with the Adherence Index to US Clinical Practice Guideline for Treating Tobacco Use and Dependence. Then, smokers with psychotic disorders evaluated the top 9 apps within a usability testing protocol. We analyzed quantitative results using descriptive statistics and t tests. Qualitative data were open-coded and analyzed for themes. Results Regarding adherence to practice guidelines, most of the randomly sampled smoking cessation apps scored poorly—66% rated lower than 10 out of 100 on the Adherence Index (Mean 11.47, SD 11.8). Regarding usability, three common usability problems emerged: text-dense content, abstract symbols on the homepage, and subtle directions to edit features. Conclusions In order for apps to be effective and usable for this population, developers should utilize a balance of text and simple design that facilitate ease of navigation and content comprehension that will help people learn quit smoking skills. PMID:28258047
van Lieshout, Remko; Pisters, Martijn F.; Vanwanseele, Benedicte; de Bie, Rob A.; Wouters, Eveline J.; Stukstette, Mirelle J.
2016-01-01
Background Partial weight bearing is frequently instructed by physical therapists in patients after lower-limb trauma or surgery. The use of biofeedback devices seems promising to improve the patient’s compliance with weight-bearing instructions. SmartStep and OpenGo-Science are biofeedback devices that provide real-time feedback. For a successful implementation, usability of the devices is a critical aspect and should be tested from a user’s perspective. Aim To describe the usability from the physical therapists’ and a patients’ perspective of Smartstep and OpenGo-Science to provide feedback on partial weight bearing during supervised rehabilitation of patients after lower-limb trauma or surgery. Methods In a convergent mixed-methods design, qualitative and quantitative data were collected. Usability was subdivided into user performance, satisfaction and acceptability. Patients prescribed with partial weight bearing and their physical therapists were asked to use SmartStep and OpenGo-Science during supervised rehabilitation. Usability was qualitatively tested by a think-aloud method and a semi-structured interview and quantitatively tested by the System-Usability-Scale (SUS) and closed questions. For the qualitative data thematic content analyses were used. Results Nine pairs of physical therapists and their patients participated. The mean SUS scores for patients and physical therapists were for SmartStep 70 and 53, and for OpenGo-Science 79 and 81, respectively. Scores were interpreted with the Curved Grading Scale. The qualitative data showed that there were mixed views and perceptions from patients and physical therapists on satisfaction and acceptability. Conclusion This study gives insight in the usability of two biofeedback devices from the patient’s and physical therapist’s perspective. The overall usability from both perspectives seemed to be acceptable for OpenGo-Science. For SmartStep, overall usability seemed only acceptable from the patient’s perspective. Implication The study findings could help clinicians to decide which biofeedback device is appropriate for their given situation and provide information for future development of biofeedback devices. PMID:27798674
Kostopoulou, O
The paper describes the process of developing a taxonomy of patient safety in general practice. The methodologies employed included fieldwork, task analysis and confidential reporting of patient-safety events in five West Midlands practices. Reported events were traced back to their root causes and contributing factors. The resulting taxonomy is based on a theoretical model of human cognition, includes multiple levels of classification to reflect the chain of causation and considers affective and physiological influences on performance. Events are classified at three levels. At level one, the information-processing model of cognition is used to classify errors. At level two, immediate causes are identified, internal and external to the individual. At level three, more remote causal factors are classified as either 'work organization' or 'technical' with subcategories. The properties of the taxonomy (validity, reliability, comprehensiveness) as well as its usability and acceptability remain to be tested with potential users.
Multimedia telehomecare system using standard TV set.
Guillén, S; Arredondo, M T; Traver, V; García, J M; Fernández, C
2002-12-01
Nowadays, there are a very large number of patients that need specific health support at home. The deployment of broadband communication networks is making feasible the provision of home care services with a proper quality of service. This paper presents a telehomecare multimedia platform that runs over integrated services digital network and internet protocol using videoconferencing standards H.320 and H.323, and standard TV set for patient interaction. This platform allows online remote monitoring: ECG, heart sound, blood pressure. Usability, affordability, and interoperability were considered for the design and development of its hardware and software components. A first evaluation of technical and usability aspects were carried forward with 52 patients of a private clinic and 10 students in the University. Results show a high rate (mean = 4.33, standard deviation--SD = 1.63 in a five-points Likert scale) in the global perception of users on the quality of images, voice, and feeling of virtual presence.
OPTIMIZING USABILITY OF AN ECONOMIC DECISION SUPPORT TOOL: PROTOTYPE OF THE EQUIPT TOOL.
Cheung, Kei Long; Hiligsmann, Mickaël; Präger, Maximilian; Jones, Teresa; Józwiak-Hagymásy, Judit; Muñoz, Celia; Lester-George, Adam; Pokhrel, Subhash; López-Nicolás, Ángel; Trapero-Bertran, Marta; Evers, Silvia M A A; de Vries, Hein
2018-01-01
Economic decision-support tools can provide valuable information for tobacco control stakeholders, but their usability may impact the adoption of such tools. This study aims to illustrate a mixed-method usability evaluation of an economic decision-support tool for tobacco control, using the EQUIPT ROI tool prototype as a case study. A cross-sectional mixed methods design was used, including a heuristic evaluation, a thinking aloud approach, and a questionnaire testing and exploring the usability of the Return of Investment tool. A total of sixty-six users evaluated the tool (thinking aloud) and completed the questionnaire. For the heuristic evaluation, four experts evaluated the interface. In total twenty-one percent of the respondents perceived good usability. A total of 118 usability problems were identified, from which twenty-six problems were categorized as most severe, indicating high priority to fix them before implementation. Combining user-based and expert-based evaluation methods is recommended as these were shown to identify unique usability problems. The evaluation provides input to optimize usability of a decision-support tool, and may serve as a vantage point for other developers to conduct usability evaluations to refine similar tools before wide-scale implementation. Such studies could reduce implementation gaps by optimizing usability, enhancing in turn the research impact of such interventions.
Effect of improving the usability of an e-learning resource: a randomized trial.
Davids, Mogamat Razeen; Chikte, Usuf M E; Halperin, Mitchell L
2014-06-01
Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0-50) recorded per participant for V1 and zero instances (range: 0-1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. Copyright © 2014 The American Physiological Society.
Effect of improving the usability of an e-learning resource: a randomized trial
Chikte, Usuf M. E.; Halperin, Mitchell L.
2014-01-01
Optimizing the usability of e-learning materials is necessary to reduce extraneous cognitive load and maximize their potential educational impact. However, this is often neglected, especially when time and other resources are limited. We conducted a randomized trial to investigate whether a usability evaluation of our multimedia e-learning resource, followed by fixing of all problems identified, would translate into improvements in usability parameters and learning by medical residents. Two iterations of our e-learning resource [version 1 (V1) and version 2 (V2)] were compared. V1 was the first fully functional version and V2 was the revised version after all identified usability problems were addressed. Residents in internal medicine and anesthesiology were randomly assigned to one of the versions. Usability was evaluated by having participants complete a user satisfaction questionnaire and by recording and analyzing their interactions with the application. The effect on learning was assessed by questions designed to test the retention and transfer of knowledge. Participants reported high levels of satisfaction with both versions, with good ratings on the System Usability Scale and adjective rating scale. In contrast, analysis of video recordings revealed significant differences in the occurrence of serious usability problems between the two versions, in particular in the interactive HandsOn case with its treatment simulation, where there was a median of five serious problem instances (range: 0–50) recorded per participant for V1 and zero instances (range: 0–1) for V2 (P < 0.001). There were no differences in tests of retention or transfer of knowledge between the two versions. In conclusion, usability evaluation followed by a redesign of our e-learning resource resulted in significant improvements in usability. This is likely to translate into improved motivation and willingness to engage with the learning material. In this population of relatively high-knowledge participants, learning scores were similar across the two versions. PMID:24913451
Usability Testing of the Indiana University Education Faculty Web Forms.
ERIC Educational Resources Information Center
Tuzun, Hakan; Lee, Sun Myung; Graham, Charles; Sluder, Kirk Job
The usability test team examined design problems that limit the ability of instructors at the Indiana University to use data entry forms on the School of Education Web site. The forms permit instructors to publish information about themselves and about courses they teach on the School of Education Web site. Faculty and graduate student instructors…
Design and Usability Testing of an Audio Platform Game for Players with Visual Impairments
ERIC Educational Resources Information Center
Oren, Michael; Harding, Chris; Bonebright, Terri L.
2008-01-01
This article reports on the evaluation of a novel audio platform game that creates a spatial, interactive experience via audio cues. A pilot study with players with visual impairments, and usability testing comparing the visual and audio game versions using both sighted players and players with visual impairments, revealed that all the…
ERIC Educational Resources Information Center
Mirel, Barbara
2001-01-01
Conducts a scenario-based usability test with 10 data analysts using visual querying (visually analyzing data with interactive graphics). Details a range of difficulties found in visual selection that, at times, gave rise to inaccurate selections, invalid conclusions, and misguided decisions. Argues that support for visual selection must be built…
Focus Groups and Usability Testing in Redesigning an Academic Library's Web Site
ERIC Educational Resources Information Center
Oldham, Bonnie W.
2008-01-01
As the World Wide Web has advanced since its inception, librarians have endeavored to keep pace with this progress in the design of their library Web pages. User recommendations collected from focus groups and usability testing have indicated that the University of Scranton's Weinberg Memorial Library's Web site was not working as intended, and…
Get out of Fines Free: Recruiting Student Usability Testers via Fine Waivers
ERIC Educational Resources Information Center
Hockenberry, Benjamin; Blackburn, Kourtney
2016-01-01
St. John Fisher College's Lavery Library's Access Services and Systems departments began a pilot project in which students with overdue fines tested usability of library Web sites in exchange for fine waivers. Circulation staff promoted the program and redeemed fine waiver vouchers at the Checkout Desk, while Systems staff administered testing and…
Mobile Learning Analytics in Higher Education: Usability Testing and Evaluation of an APP Prototype
ERIC Educational Resources Information Center
Kuhnel, Matthias; Seiler, Luisa; Honal, Andrea; Ifenthaler, Dirk
2017-01-01
This study aims to test the usability of MyLA (My Learning Analytics), an application for students at two German universities: The Cooperative State University Mannheim and University of Mannheim. The participating universities focus on the support of personalized and self-regulated learning. MyLA collects data such as learning behavior and…
Hill, Annie J.; Breslin, Hugh M.
2016-01-01
Asynchronous telerehabilitation in which computer-based interventions are remotely monitored and adapted offline is an emerging service delivery model in the rehabilitation of communication disorders. The asynchronous nature of this model may hold a benefit over its synchronous counterpart by eliminating scheduling issues and thus improving efficiency in a healthcare landscape of constrained resource allocation. The design of asynchronous telerehabilitation platforms should therefore ensure efficiency and flexibility. The authors have been engaged in a program of research to develop and evaluate an asynchronous telerehabilitation platform for use in speech-language pathology. eSALT is a novel asynchronous telerehabilitation platform in which clinicians design and individualize therapy tasks for transfer to a client's mobile device. An inbuilt telerehabilitation module allows for remote monitoring and updating of tasks. This paper introduces eSALT and reports outcomes from an usability study that considered the needs of two end-user groups, people with aphasia and clinicians, in the on-going refinement of eSALT. In the study participants with aphasia were paired with clinicians who used eSALT to design and customize therapy tasks. After training on the mobile device the participants engaged in therapy at home for a period of 3 weeks, while clinicians remotely monitored and updated tasks. Following the home trial, participants, and clinicians engaged in semi-structured interviews and completed surveys on the usability of eSALT and their satisfaction with the platform. Content analysis of data involving five participants and three clinicians revealed a number of usability themes including ease of use, user support, satisfaction, limitations, and potential improvements. These findings were translated into a number of refinements of the eSALT platform including the development of a client interface for use on the Apple iPad®, greater variety in feedback options to both the participant and clinician, automatic transfer of results to the clinician, and expansion of the task template list. This research highlights the importance of including end-users in the process of technology refinement, in order to ensure effective and efficient use of the technology. Future directions for research are discussed including clinical trials in which the effectiveness of and adherence to intervention protocols using asynchronous telerehabilitation are examined. PMID:28066211
Vedanthan, Rajesh; Blank, Evan; Tuikong, Nelly; Kamano, Jemima; Misoi, Lawrence; Tulienge, Deborah; Hutchinson, Claire; Ascheim, Deborah D; Kimaiyo, Sylvester; Fuster, Valentin; Were, Martin C
2015-03-01
Mobile health (mHealth) applications have recently proliferated, especially in low- and middle-income countries, complementing task-redistribution strategies with clinical decision support. Relatively few studies address usability and feasibility issues that may impact success or failure of implementation, and few have been conducted for non-communicable diseases such as hypertension. To conduct iterative usability and feasibility testing of a tablet-based Decision Support and Integrated Record-keeping (DESIRE) tool, a technology intended to assist rural clinicians taking care of hypertension patients at the community level in a resource-limited setting in western Kenya. Usability testing consisted of "think aloud" exercises and "mock patient encounters" with five nurses, as well as one focus group discussion. Feasibility testing consisted of semi-structured interviews of five nurses and two members of the implementation team, and one focus group discussion with nurses. Content analysis was performed using both deductive codes and significant inductive codes. Critical incidents were identified and ranked according to severity. A cause-of-error analysis was used to develop corresponding design change suggestions. Fifty-seven critical incidents were identified in usability testing, 21 of which were unique. The cause-of-error analysis yielded 23 design change suggestions. Feasibility themes included barriers to implementation along both human and technical axes, facilitators to implementation, provider issues, patient issues and feature requests. This participatory, iterative human-centered design process revealed previously unaddressed usability and feasibility issues affecting the implementation of the DESIRE tool in western Kenya. In addition to well-known technical issues, we highlight the importance of human factors that can impact implementation of mHealth interventions. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.
Vedanthan, Rajesh; Blank, Evan; Tuikong, Nelly; Kamano, Jemima; Misoi, Lawrence; Tulienge, Deborah; Hutchinson, Claire; Ascheim, Deborah D.; Kimaiyo, Sylvester; Fuster, Valentin; Were, Martin C.
2015-01-01
Background Mobile health (mHealth) applications have recently proliferated, especially in low- and middle-income countries, complementing task-redistribution strategies with clinical decision support. Relatively few studies address usability and feasibility issues that may impact success or failure of implementation, and few have been conducted for non-communicable diseases such as hypertension. Objective To conduct iterative usability and feasibility testing of a tablet-based Decision Support and Integrated Record-keeping (DESIRE) tool, a technology intended to assist rural clinicians taking care of hypertension patients at the community level in a resource-limited setting in western Kenya. Methods Usability testing consisted of “think aloud” exercises and “mock patient encounters” with five nurses, as well as one focus group discussion. Feasibility testing consisted of semi-structured interviews of five nurses and two members of the implementation team, and one focus group discussion with nurses. Content analysis was performed using both deductive codes and significant inductive codes. Critical incidents were identified and ranked according to severity. A cause-of-error analysis was used to develop corresponding design change suggestions. Results Fifty-seven critical incidents were identified in usability testing, 21 of which were unique. The cause-of-error analysis yielded 23 design change suggestions. Feasibility themes included barriers to implementation along both human and technical axes, facilitators to implementation, provider issues, patient issues and feature requests. Conclusions This participatory, iterative human-centered design process revealed previously unaddressed usability and feasibility issues affecting the implementation of the DESIRE tool in western Kenya. In addition to well-known technical issues, we highlight the importance of human factors that can impact implementation of mHealth interventions. PMID:25612791
Kim, Min Soon; Aro, Michael R; Lage, Kraig J; Ingalls, Kevin L; Sindhwani, Vivek; Markey, Mia K
2016-03-01
The objective of this study was to conduct a usability evaluation of mobile apps for supporting education and training in radiologic diagnostic decision-making processes. Of 381 mobile apps available at two major stores (Google Play and iTunes), eight iOS apps were selected for laboratory-based usability tests. Six staff radiologists completed eight app-specific task sets, using a think-aloud strategy. The triangular methods approach included quantitative performance measures, System Usability Scale (SUS), and qualitative thematic analysis using heuristic usability principles of usability issues. Overall, radiologists achieved higher than 70% success, with favorable SUS scores, in completing the tasks for seven of the eight apps. However, task success rate and SUS score had a weak relation (r = 0.23), indicating that the perceived usability may not reflect the holistic usability of the app. Task analysis and self-report revealed 108 usability issues, which were condensed to 55 unique issues and categorized by nine usability themes and mapped to ten usability heuristics. Nonintuitive functionality (eg, nonintuitive or misleading labels) was the most frequent theme observed, leading to inefficient navigation. These usability findings were consistent with the 13 improvements the radiologists suggested. This study demonstrates the feasibility of usability evaluation of radiology mobile apps and suggests potential improvements in the development of radiology mobile apps. This study also suggests that proficiency with mobile devices may not be equivalent to being an expert user, proficient in using the apps. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.
Jacova, Claudia; McGrenere, Joanna; Lee, Hyunsoo S; Wang, William W; Le Huray, Sarah; Corenblith, Emily F; Brehmer, Matthew; Tang, Charlotte; Hayden, Sherri; Beattie, B Lynn; Hsiung, Ging-Yuek R
2015-01-01
Cognitive Testing on Computer (C-TOC) is a novel computer-based test battery developed to improve both usability and validity in the computerized assessment of cognitive function in older adults. C-TOC's usability was evaluated concurrently with its iterative development to version 4 in subjects with and without cognitive impairment, and health professional advisors representing different ethnocultural groups. C-TOC version 4 was then validated against neuropsychological tests (NPTs), and by comparing performance scores of subjects with normal cognition, Cognitive Impairment Not Dementia (CIND) and Alzheimer disease. C-TOC's language tests were validated in subjects with aphasic disorders. The most important usability issue that emerged from consultations with 27 older adults and with 8 cultural advisors was the test-takers' understanding of the task, particularly executive function tasks. User interface features did not pose significant problems. C-TOC version 4 tests correlated with comparator NPT (r=0.4 to 0.7). C-TOC test scores were normal (n=16)>CIND (n=16)>Alzheimer disease (n=6). All normal/CIND NPT performance differences were detected on C-TOC. Low computer knowledge adversely affected test performance, particularly in CIND. C-TOC detected impairments in aphasic disorders (n=11). In general, C-TOC had good validity in detecting cognitive impairment. Ensuring test-takers' understanding of the tasks, and considering their computer knowledge appear important steps towards C-TOC's implementation.
75 FR 14145 - Agency Information Collection Activities: Proposed Collection; Comment Request
Federal Register 2010, 2011, 2012, 2013, 2014
2010-03-24
... made in response to usability testing as well as internal review. Changes have also been made to... burden of reporting using the electronic software and improve usability. The affected questions can be...
Usability Evaluation of NLP-PIER: A Clinical Document Search Engine for Researchers.
Hultman, Gretchen; McEwan, Reed; Pakhomov, Serguei; Lindemann, Elizabeth; Skube, Steven; Melton, Genevieve B
2017-01-01
NLP-PIER (Natural Language Processing - Patient Information Extraction for Research) is a self-service platform with a search engine for clinical researchers to perform natural language processing (NLP) queries using clinical notes. We conducted user-centered testing of NLP-PIER's usability to inform future design decisions. Quantitative and qualitative data were analyzed. Our findings will be used to improve the usability of NLP-PIER.
Usability in telemedicine systems-A literature survey.
Klaassen, B; van Beijnum, B J F; Hermens, H J
2016-09-01
The rapid development of sensors and communication technologies enable the growth of new innovative services in healthcare, such as Telemedicine. An essential ingredient in the development of a telemedicine system and its final acceptance by end users are usability studies. The principles of usability engineering, evaluations and telemedicine are well established, and it may contribute to the adoption and eventually deployment of such systems and services. An in-depth usability analysis, including performance and attitude measures, requires knowledge about available usability techniques, and is depending on the amount of resources. Therefore it is worth investigating how usability methods are applied in developing telemedicine systems. Our hypothesis is: with increasing research and development of telemedicine systems, we expect that various usability methods are more equally employed for different end-user groups and applications. A literature survey was conducted to find telemedicine systems that have been evaluated for usability or ease of use. The elements of the PICO framework were used as a basis for the selection criteria in the literature search. The search was not limited by year. Two independent reviewers screened all search results first by title, and then by abstract for inclusion. Articles were included up to May 2015. In total, 127 publications were included in this survey. The number of publications on telemedicine systems significantly increased after 2008. Older adults and end-users with cardiovascular conditions were among largest target end-user groups. Remote monitoring systems were found the most, in 90 publications. Questionnaires are the most common means for evaluating telemedicine systems, and were found in 88 publications. Questionnaires are used frequently in studies focusing on cardiovascular diseases, Parkinson's disease and older adult conditions. Interviews are found the most in publications related to stroke. In total 71% of the publications were trial-orientated and the remaining process orientated. An increase in telemedicine research, development and applications is found worldwide, with the majority of publications conducted in America. Monitoring patients in their homes can lead to better healthcare at lower costs which implies an increased demand of new healthcare strategies like telemedicine. We expected that with the increase in telemedicine research and development, a greater range of usability methods would also be employed in the included publications. This is not the case. Researchers employed questionnaires as a preferred usability method for each type of telemedicine system and most end-users. However, in process-orientated studies a greater range of usability evaluations were applied, with fewer differences found in the amount of publications for each evaluation method. Questionnaires enable researchers to evaluate a system quickly on end users, as it requires less expertise on the evaluation method compared to the other methods. They are easily distributed and are customizable. The use of questionnaires is therefore an evaluation method of choice for a variety of telemedicine systems and end-users. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
Sajatovic, Martha; Davis, Michael S; Cassidy, Kristin A; Nestor, Joseph; Sams, Johnny; Fuentes-Casiano, Edna
2015-01-01
Objective As poor medication adherence is common in bipolar disorder (BD), technology-assisted approaches may help to monitor and enhance adherence. This study evaluated preliminary feasibility, patient satisfaction and effects on adherence, BD knowledge, and BD symptoms associated with the use of a multicomponent technology-assisted adherence enhancement system. Methods This prospective study tested the system in five BD patients over a 15-day period. System components included: 1) an automated pill cap with remote monitoring sensor; 2) a multimedia adherence enhancement program; and 3) a treatment incentive program. This study evaluated system usability, patient satisfaction and effects on adherence (Morisky scale), knowledge (treatment knowledge test [TKT]), and symptoms (internal state scale [ISS]). Results Mean age of the sample was 62 years, 4/5 (80%) Caucasian, and 4/5 (80%) single/divorced or widowed. Most participants (4/5, 80%) were on a single BD medication. Participants had BD for an average of 21 years. Challenges included attaching the pill sensor to standard pharmacy bottles for individuals using very large pill containers or those with multiday pill boxes. Three of five (60%) individuals completed the full 15-day period. Usability scores were high overall. Mean Morisky scores improved. Means on all four subscales of the ISS were all in the direction of improvement. On the TKT, there was a 40% increase in mean scores. Conclusion A multicomponent technology-assisted BD adherence enhancement system is feasible. Challenges include accommodating multiple types of pill containers and monitoring multiple drugs simultaneously. The system can also generate adherence information that is potentially useful for treatment planning. PMID:26089652
Krause, Paul; de Lusignan, Simon
2010-01-01
The allure of interoperable systems is that they should improve patient safety and make health services more efficient. The UK's National Programme for IT has made great strides in achieving interoperability; through linkage to a national electronic spine. However, there has been criticism of the usability of the applications in the clinical environment. Analysis of the procurement and assurance process to explore whether they predetermine usability. Processes separate developers from users, and test products against theoretical assurance models of use rather than simulate or pilot in a clinical environment. The current process appears to be effective for back office systems and high risk applications, but too inflexible for developing applications for the clinical setting. For clinical applications agile techniques are more appropriate. Usability testing should become an integrated part of the contractual process and be introduced earlier in the development process.
Lessons learned from the usability assessment of home-based telemedicine systems.
Agnisarman, Sruthy Orozhiyathumana; Chalil Madathil, Kapil; Smith, Kevin; Ashok, Aparna; Welch, Brandon; McElligott, James T
2017-01-01
At-home telemedicine visits are quickly becoming an acceptable alternative for in-person patient visits. However, little work has been done to understand the usability of these home-based telemedicine solutions. It is critical for user acceptance and real-world applicability to evaluate available telemedicine solutions within the context-specific needs of the users of this technology. To address this need, this study evaluated the usability of four home-based telemedicine software platforms: Doxy.me, Vidyo, VSee, and Polycom. Using a within-subjects experimental design, twenty participants were asked to complete a telemedicine session involving several tasks using the four platforms. Upon completion of these tasks for each platform, participants completed the IBM computer system usability questionnaire (CSUQ) and the NASA Task Load Index test. Upon completing the tasks on all four platforms, the participants completed a final post-test subjective questionnaire ranking the platforms based on their preference. Of the twenty participants, 19 completed the study. Statistically significant differences among the telemedicine software platforms were found for task completion time, total workload, mental demand, effort, frustration, preference ranking and computer system usability scores. Usability problems with installation and account creation led to high mental demand and task completion time, suggesting the participants preferred a system without such requirements. Majority of the usability issues were identified at the telemedicine initiation phase. The findings from this study can be used by software developers to develop user-friendly telemedicine systems. Copyright © 2016 Elsevier Ltd. All rights reserved.
Usability Testing, User-Centered Design, and LibGuides Subject Guides: A Case Study
ERIC Educational Resources Information Center
Sonsteby, Alec; DeJonghe, Jennifer
2013-01-01
Usability testing has become a routine way for many libraries to ensure that their Web presence is user-friendly and accessible. At the same time, popular subject guide creation systems, such as LibGuides, decentralize Web content creation and put authorship into the hands of librarians who may not be trained in user-centered design principles. At…
ERIC Educational Resources Information Center
Hamel, Marie-Josee
2012-01-01
This article reports on a study which took place in the context of the design and development of an online dictionary prototype for learners of French. Aspects of the "usability", i.e. the quality of the "learner-task-dictionary interaction" of the prototype were tested. Micro-tasks were designed to focus on learners'…
Nurses' perceptions and problems in the usability of a medication safety app.
Ankem, Kalyani; Cho, Sookyung; Simpson, Diana
2017-10-16
The majority of medication apps support medication adherence. Equally, if not more important, is medication safety. Few apps report on medication safety, and fewer studies have been conducted with these apps. The usability of a medication safety app was tested with nurses to reveal their perceptions of the graphical user interface and to discover problems they encountered in using the app. Usability testing of the app was conducted with RN-BSN students and informatics students (n = 18). Perceptions of the graphical components were gathered in pretest and posttest questionnaires, and video recordings of the usability testing were transcribed. The significance of the difference in mean performance time for 8 tasks was tested, and qualitative analysis was deployed to identify problems encountered and to rate the severity of each problem. While all participants perceived the graphical user interface as easy to understand, nurses took significantly more time to complete certain tasks. More nurses found the medication app to be lacking in intuitiveness of user interface design, in capability to match real-world data, and in providing optimal information architecture. To successfully integrate mobile devices in healthcare, developers must address the problems that nurses encountered in use of the app.
Sanders, G D; Nease, R F; Owens, D K
2000-01-01
Local tailoring of clinical practice guidelines (CPGs) requires experts in medicine and evidence synthesis unavailable in many practice settings. The authors' computer-based system enables developers and users to create, disseminate, and tailor CPGs, using normative decision models (DMs). ALCHEMIST, a web-based system, analyzes a DM, creates a CPG in the form of an annotated algorithm, and displays for the guideline user the optimal strategy. ALCHEMIST'S interface enables remote users to tailor the guideline by changing underlying input variables and observing the new annotated algorithm that is developed automatically. In a pilot evaluation of the system, a DM was used to evaluate strategies for staging non-small-cell lung cancer. Subjects (n = 15) compared the automatically created CPG with published guidelines for this staging and critiqued both using a previously developed instrument to rate the CPGs' usability, accountability, and accuracy on a scale of 0 (worst) to 2 (best), with higher scores reflecting higher quality. The mean overall score for the ALCHEMIST CPG was 1.502, compared with the published-CPG score of 0.987 (p = 0.002). The ALCHEMIST CPG scores for usability, accountability, and accuracy were 1.683, 1.393, and 1.430, respectively; the published CPG scores were 1.192, 0.941, and 0.830 (each comparison p < 0.05). On a scale of 1 (worst) to 5 (best), users' mean ratings of ALCHEMIST'S ease of use, usefulness of content, and presentation format were 4.76, 3.98, and 4.64, respectively. The results demonstrate the feasibility of a web-based system that automatically analyzes a DM and creates a CPG as an annotated algorithm, enabling remote users to develop site-specific CPGs. In the pilot evaluation, the ALCHEMIST guidelines met established criteria for quality and compared favorably with national CPGs. The high usability and usefulness ratings suggest that such systems can be a good tool for guideline development.
Saris-Baglama, Renee N.; Smith, Kevin J.; DeRosa, Michael A.; Paulsen, Christine A.; Hogue, Sarah J.
2011-01-01
Abstract Objective The aim of this study was to evaluate usability of a prototype tablet PC-administered computerized adaptive test (CAT) of headache impact and patient feedback report, referred to as HEADACHE-CAT. Materials and Methods Heuristic evaluation specialists (n = 2) formed a consensus opinion on the application's strengths and areas for improvement based on general usability principles and human factors research. Usability testing involved structured interviews with headache sufferers (n = 9) to assess how they interacted with and navigated through the application, and to gather input on the survey and report interface, content, visual design, navigation, instructions, and user preferences. Results Specialists identified the need for improved instructions and text formatting, increased font size, page setup that avoids scrolling, and simplified presentation of feedback reports. Participants found the tool useful, and indicated a willingness to complete it again and recommend it to their healthcare provider. However, some had difficulty using the onscreen keyboard and autoadvance option; understanding the difference between generic and headache-specific questions; and interpreting score reports. Conclusions Heuristic evaluation and user testing can help identify usability problems in the early stages of application development, and improve the construct validity of electronic assessments such as the HEADACHE-CAT. An improved computerized HEADACHE-CAT measure can offer headache sufferers an efficient tool to increase patient self-awareness, monitor headaches over time, aid patient–provider communications, and improve quality of life. PMID:21214341
Checking an integrated model of web accessibility and usability evaluation for disabled people.
Federici, Stefano; Micangeli, Andrea; Ruspantini, Irene; Borgianni, Stefano; Corradi, Fabrizio; Pasqualotto, Emanuele; Olivetti Belardinelli, Marta
2005-07-08
A combined objective-oriented and subjective-oriented method for evaluating accessibility and usability of web pages for students with disability was tested. The objective-oriented approach is devoted to verifying the conformity of interfaces to standard rules stated by national and international organizations responsible for web technology standardization, such as W3C. Conversely, the subjective-oriented approach allows assessing how the final users interact with the artificial system, accessing levels of user satisfaction based on personal factors and environmental barriers. Five kinds of measurements were applied as objective-oriented and subjective-oriented tests. Objective-oriented evaluations were performed on the Help Desk web page for students with disability, included in the website of a large Italian state university. Subjective-oriented tests were administered to 19 students labeled as disabled on the basis of their own declaration at the University enrolment: 13 students were tested by means of the SUMI test and six students by means of the 'Cooperative evaluation'. Objective-oriented and subjective-oriented methods highlighted different and sometimes conflicting results. Both methods have pointed out much more consistency regarding levels of accessibility than of usability. Since usability is largely affected by individual differences in user's own (dis)abilities, subjective-oriented measures underscored the fact that blind students encountered much more web surfing difficulties.
Developing iCare v.1.0: an academic electronic health record.
Wyatt, Tami H; Li, Xueping; Indranoi, Chayawat; Bell, Matthew
2012-06-01
An electronic health record application, iCare v.1.0, was developed and tested that allows data input and retrieval while tracking student performance over time. The development and usability testing of iCare v.1.0 followed a rapid prototyping software development and testing model. Once the functionality was tested by engineers, the usability and feasibility testing began with a convenience sample of focus group members including undergraduate and graduate students and faculty. Three focus groups were created, and four subjects participated in each focus group (n = 12). Nielsen's usability heuristics and methods of evaluation were used to evaluate data captured from each focus group. Overall, users wanted a full-featured electronic health record with features that coached or guided users. The earliest versions of iCare v.1.0 did not provide help features and prompts to guide students but were later added. Future versions will incorporate a full-featured help section. The interface and design of iCare v.1.0 are similar to professional electronic health record applications. As a result of this usability study, future versions of iCare will include more robust help features along with advanced reporting and elements specific to specialty populations such as pediatrics and mental health services.
NASA Technical Reports Server (NTRS)
Odenyo, V. A. O.
1975-01-01
Remote sensing data on computer-compatible tapes of LANDSAT 1 multispectral scanner imager were analyzed to generate a land use map of the City of Virginia Beach. All four bands were used in both the supervised and unsupervised approaches with the LAYSYS software system. Color IR imagery of a U-2 flight of the same area was also digitized and two sample areas were analyzed via the unsupervised approach. The relationships between the mapped land use and the soils of the area were investigated. A land use land cover map at a scale of 1:24,000 was obtained from the supervised analysis of LANDSAT 1 data. It was concluded that machine analysis of remote sensing data to produce land use maps was feasible; that the LAYSYS software system was usable for this purpose; and that the machine analysis was capable of extracting detailed information from the relatively small scale LANDSAT data in a much shorter time without compromising accuracy.
Towards Usable E-Health. A Systematic Review of Usability Questionnaires.
Sousa, Vanessa E C; Dunn Lopez, Karen
2017-05-10
The use of e-health can lead to several positive outcomes. However, the potential for e-health to improve healthcare is partially dependent on its ease of use. In order to determine the usability for any technology, rigorously developed and appropriate measures must be chosen. To identify psychometrically tested questionnaires that measure usability of e-health tools, and to appraise their generalizability, attributes coverage, and quality. We conducted a systematic review of studies that measured usability of e-health tools using four databases (Scopus, PubMed, CINAHL, and HAPI). Non-primary research, studies that did not report measures, studies with children or people with cognitive limitations, and studies about assistive devices or medical equipment were systematically excluded. Two authors independently extracted information including: questionnaire name, number of questions, scoring method, item generation, and psychometrics using a data extraction tool with pre-established categories and a quality appraisal scoring table. Using a broad search strategy, 5,558 potentially relevant papers were identified. After removing duplicates and applying exclusion criteria, 35 articles remained that used 15 unique questionnaires. From the 15 questionnaires, only 5 were general enough to be used across studies. Usability attributes covered by the questionnaires were: learnability (15), efficiency (12), and satisfaction (11). Memorability (1) was the least covered attribute. Quality appraisal showed that face/content (14) and construct (7) validity were the most frequent types of validity assessed. All questionnaires reported reliability measurement. Some questionnaires scored low in the quality appraisal for the following reasons: limited validity testing (7), small sample size (3), no reporting of user centeredness (9) or feasibility estimates of time, effort, and expense (7). Existing questionnaires provide a foundation for research on e-health usability. However, future research is needed to broaden the coverage of the usability attributes and psychometric properties of the available questionnaires.
Fu, Mei R; Axelrod, Deborah; Guth, Amber A; Wang, Yao; Scagliola, Joan; Hiotis, Karen; Rampertaap, Kavita; El-Shammaa, Nardin
2016-09-01
The-Optimal-Lymph-Flow health IT system (TOLF) is a patient-centered, web-and-mobile-based educational and behavioral health IT system focusing on safe, innovative, and pragmatic self-care strategies for lymphedema symptom management. The purpose of this study was to evaluate usability, feasibility, and acceptability of TOLF among the end-user of breast cancer survivors. Two types of usability testing were completed with 30 breast cancer survivors: heuristic evaluation and end-user testing. Each participant was asked to think aloud while completing a set of specified tasks designed to explicate and freely explore the system features. A heuristic evaluation checklist, the Perceived Ease of Use and Usefulness Questionnaire, and The Post Study System Usability Questionnaire were used to evaluate usability of the system. Open-ended questions were used to gather qualitative data. Quantitative data were analyzed using descriptive statistics and qualitative data were summarized thematically. Breast cancer survivors were very satisfied with the system: 90% (n = 27) rated the system having no usability problems; 10% (n = 3) noted minor cosmetic problems: spelling errors or text font size. The majority of participants 96.6% (n = 29) strongly agreed that the system was easy to use and effective in helping to learn about lymphedema, symptoms and self-care strategies. Themes from the qualitative data included empowerment, high quality information, loving avatar simulation videos, easy accessibility, and user-friendliness. This usability study provided evidence on breast cancer survivor's acceptance and highly positive evaluation of TOLF's usability as well as feasibility of using technologically-driven delivery model to enhance self-care strategies for lymphedema symptom management.
A usability evaluation of four commercial dental computer-based patient record systems
Thyvalikakath, Thankam P.; Monaco, Valerie; Thambuganipalle, Hima Bindu; Schleyer, Titus
2008-01-01
Background The usability of dental computer-based patient record (CPR) systems has not been studied, despite early evidence that poor usability is a problem for dental CPR system users at multiple levels. Methods The authors conducted formal usability tests of four dental CPR systems by using a purposive sample of four groups of five novice users. The authors measured task outcomes (correctly completed, incorrectly completed and incomplete) in each CPR system while the participants performed nine clinical documentation tasks, as well as the number of usability problems identified in each CPR system and their potential relationship to task outcomes. The authors reviewed the software application design aspects responsible for these usability problems. Results The range for correctly completed tasks was 16 to 64 percent, for incorrectly completed tasks 18 to 38 percent and for incomplete tasks 9 to 47 percent. The authors identified 286 usability problems. The main types were three unsuccessful attempts, negative affect and task incorrectly completed. They also identified six problematic interface and interaction designs that led to usability problems. Conclusion The four dental CPR systems studied have significant usability problems for novice users, resulting in a steep learning curve and potentially reduced system adoption. Clinical Implications The significant number of data entry errors raises concerns about the quality of documentation in clinical practice. PMID:19047669
Schaarup, Clara; Hartvigsen, Gunnar; Larsen, Lars Bo; Tan, Zheng-Hua; Årsand, Eirik; Hejlesen, Ole Kristian
2015-01-01
The Online Diabetes Exercise System was developed to motivate people with Type 2 diabetes to do a 25 minutes low-volume high-intensity interval training program. In a previous multi-method evaluation of the system, several usability issues were identified and corrected. Despite the thorough testing, it was unclear whether all usability problems had been identified using the multi-method evaluation. Our hypothesis was that adding the eye-tracking triangulation to the multi-method evaluation would increase the accuracy and completeness when testing the usability of the system. The study design was an Eye-tracking Triangulation; conventional eye-tracking with predefined tasks followed by The Post-Experience Eye-Tracked Protocol (PEEP). Six Areas of Interests were the basis for the PEEP-session. The eye-tracking triangulation gave objective and subjective results, which are believed to be highly relevant for designing, implementing, evaluating and optimizing systems in the field of health informatics. Future work should include testing the method on a larger and more representative group of users and apply the method on different system types.
Yuen, Erica K; Gros, Kirstin; Welsh, Kyleen E; McCauley, Jenna; Resnick, Heidi S; Danielson, Carla K; Price, Matthew; Ruggiero, Kenneth J
2016-09-01
Technology-based self-help interventions have the potential to increase access to evidence-based mental healthcare, especially for families affected by natural disasters. However, development of these interventions is a complex process and poses unique challenges. Usability testing, which assesses the ability of individuals to use an application successfully, can have a significant impact on the quality of a self-help intervention. This article describes (a) the development of a novel web-based multi-module self-help intervention for disaster-affected adolescents and their parents and (b) a mixed-methods formal usability study to evaluate user response. A total of 24 adolescents were observed, videotaped, and interviewed as they used the depressed mood component of the self-help intervention. Quantitative results indicated an above-average user experience, and qualitative analysis identified 120 unique usability issues. We discuss the challenges of developing self-help applications, including design considerations and the value of usability testing in technology-based interventions, as well as our plan for widespread dissemination. © The Author(s) 2015.
Designing mobile dietary management support technologies for people with diabetes.
Arsand, Eirik; Tufano, James T; Ralston, James D; Hjortdahl, Per
2008-01-01
We performed two cycles of laboratory-based usability testing of three food registration prototypes for people with diabetes. The design concepts were a commercial web application, various smartphones and a mobile phone photo blogging approach. Six adults with Type 1 diabetes and three adults with Type 2 diabetes participated in the usability tests. The results provided five distinct implications for devices for the future dietary management support of people with diabetes. Study participants valued many of the features offered by the three systems that were tested, although the usability tests also revealed several opportunities to enhance their design. Our findings suggest that further development is justified of mobile dietary and nutritional support for individuals living with diabetes. Applications that support healthy eating habits should be integrated with applications for managing blood glucose data and physical activity data, and potentially medication data as well.
Logistical Consideration in Computer-Based Screening of Astronaut Applicants
NASA Technical Reports Server (NTRS)
Galarza, Laura
2000-01-01
This presentation reviews the logistical, ergonomic, and psychometric issues and data related to the development and operational use of a computer-based system for the psychological screening of astronaut applicants. The Behavioral Health and Performance Group (BHPG) at the Johnson Space Center upgraded its astronaut psychological screening and selection procedures for the 1999 astronaut applicants and subsequent astronaut selection cycles. The questionnaires, tests, and inventories were upgraded from a paper-and-pencil system to a computer-based system. Members of the BHPG and a computer programmer designed and developed needed interfaces (screens, buttons, etc.) and programs for the astronaut psychological assessment system. This intranet-based system included the user-friendly computer-based administration of tests, test scoring, generation of reports, the integration of test administration and test output to a single system, and a complete database for past, present, and future selection data. Upon completion of the system development phase, four beta and usability tests were conducted with the newly developed system. The first three tests included 1 to 3 participants each. The final system test was conducted with 23 participants tested simultaneously. Usability and ergonomic data were collected from the system (beta) test participants and from 1999 astronaut applicants who volunteered the information in exchange for anonymity. Beta and usability test data were analyzed to examine operational, ergonomic, programming, test administration and scoring issues related to computer-based testing. Results showed a preference for computer-based testing over paper-and -pencil procedures. The data also reflected specific ergonomic, usability, psychometric, and logistical concerns that should be taken into account in future selection cycles. Conclusion. Psychological, psychometric, human and logistical factors must be examined and considered carefully when developing and using a computer-based system for psychological screening and selection.
Usability 101: A Pilot Test of DOE PAGES Beta | OSTI, US Dept of Energy
Office of Scientific and Technical Information skip to main content Sign In Create Account OSTI.GOV title logo U.S. Department of Energy Office of Scientific and Technical Information Search terms News Sign In Create Account This page is being shared by OSTI.GOV. Usability 101: A Pilot Test of DOE
Usability testing of a Falls Prevention Tool Kit for an inpatient acute care setting.
Goldsmith, Denise; Zuyev, Lyubov; Benoit, Angie; Chang, Frank Y; Horsky, Jan; Dykes, Patricia
2009-01-01
Efforts to prevent falls in the hospital setting involves identifying patients at risk of falling and implementing fall prevention strategies. This poster describes the method and results of Performance Usability Testing on a web-based Fall Prevention Tool Kit (FPTK) developed as part of a research study, (Falls TIPS-Tailoring Interventions for Patient Safety) funded by The Robert Wood Johnson Foundation.
Capturing, Harmonizing and Delivering Data and Quality Provenance
NASA Technical Reports Server (NTRS)
Leptoukh, Gregory; Lynnes, Christopher
2011-01-01
Satellite remote sensing data have proven to be vital for various scientific and applications needs. However, the usability of these data depends not only on the data values but also on the ability of data users to assess and understand the quality of these data for various applications and for comparison or inter-usage of data from different sensors and models. In this paper, we describe some aspects of capturing, harmonizing and delivering this information to users in the framework of distributed web-based data tools.
Use of data from space for earth resources exploration and management in Alabama
NASA Technical Reports Server (NTRS)
Lamoreaux, P. E.; Henry, H. R.
1972-01-01
The University of Alabama, the Geological Survey of Alabama, and the George C. Marshall Space Flight Center are involved in an interagency, interdisciplinary effort to use remotely sensed, multispectral observations to yield improved and timely assessment of earth resources and environmental quality in Alabama. It is the goal of this effort to interpret these data and provide them in a format which is meaningful to and readily usable by agencies, industries, and individuals who are potential users throughout the State.
Finding online health-related information: usability issues of health portals.
Gurel Koybasi, Nergis A; Cagiltay, Kursat
2012-01-01
As Internet and computers become widespread, health portals offering online health-related information become more popular. The most important point for health portals is presenting reliable and valid information. Besides, portal needs to be usable to be able to serve information to users effectively. This study aims to determine usability issues emerging when health-related information is searched on a health portal. User-based usability tests are conducted and eye movement analyses are used in addition to traditional performance measures. Results revealed that users prefer systematic, simple and consistent designs offering interactive tools. Moreover, content and partitions needs to be shaped according to the medical knowledge of target users.
A Prototype Mobile Application for Triaging Dental Emergencies
Stein, Corey D.; Xiao, Xiang; Levine, Steven; Schleyer, Titus K. L.; Hochheiser, Harry; Thyvalikakath, Thankam P
2016-01-01
Evidence suggests that dental emergencies are likely to occur when preferred care is less accessible. Communicative barriers often exist that cause patients to receive sub-optimal treatment or remain in discomfort for extended lengths of time. Furthermore, limitations in the conventional approach for managing dental emergencies prevent dentists from receiving critical information prior to patient visits. We developed a mobile application to mediate the uncertainty of dental emergencies. Patient-provided information accompanied by high-resolution images may significantly help dentists predict urgency or prepare necessary treatment resources. The development and study consisted of a needs analysis and quality assessment of intraoral images captured by smartphones; prototype development; refining the prototype through usability inspection methods; and formative evaluation through usability testing with prospective users. The developed application successfully guided all users through a series of questions designed to capture clinically meaningful data using familiar smartphone functions. All participants were able to complete a report within 4 minutes and all clinical information was comprehendible by the users. Our results illustrate the feasibility of patients utilizing smartphone applications to report dental emergencies. This technology allows dentists to remotely assess care when direct patient contact is less practical. This study demonstrates that patients can use mobile applications to transmit clinical data to their dentists and suggests the possibility of expanding its use to enhance access to routine and emergency dental care. Here, we address how we can enable patients to directly communicate emergent needs to a dentist while relieving them of enduring emergency room visits. PMID:27206728
Cristancho-Lacroix, Victoria; Moulin, Florence; Wrobel, Jérémy; Batrancourt, Bénédicte; Plichart, Matthieu; De Rotrou, Jocelyne; Cantegreil-Kallen, Inge; Rigaud, Anne-Sophie
2014-09-15
Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.
NASA Technical Reports Server (NTRS)
Lamarr, Michael; Chinske, Chris; Williams, Ethan; Law, Cameron; Skoog, Mark; Sorokowski, Paul
2016-01-01
The NASA improved Ground Collision Avoidance System (iGCAS) team conducted an onsite usability study at Experimental Aircraft Association (EAA) Air Venture in Oshkosh, Wisconsin from July 19 through July 26, 2015. EAA Air Venture had approximately 550,000 attendees from which the sample pool of pilots were selected. The objectives of this study were to assess the overall appropriateness and acceptability of iGCAS as a warning system for General Aviation aircraft, usability of the iGCAS displays and audio cues, test terrain avoidance characteristics, performance, functionality, pilot response time, and correlate terrain avoidance performance and pilot response time data.
Hudson, Darren; Kushniruk, Andre; Borycki, Elizabeth; Zuege, Danny J
2018-04-01
Physician satisfaction with electronic medical records has often been poor. Usability has frequently been identified as a source for decreased satisfaction. While surveys can identify many issues, and are logistically easier to administer, they may miss issues identified using other methods This study sought to understand the level of physician satisfaction and usability issues associated with a critical care clinical information system (eCritical Alberta) implemented throughout the province of Alberta, Canada. All critical care attending physicians using the system were invited to participate in an online survey. Questions included components of the User Acceptance of Information Technology and Usability Questionnaire as well as free text feedback on system components. Physicians were also invited to participate in a think aloud test using simulated scenarios. The transcribed think aloud text and questionnaire were subjected to textual analysis. 82% of all eligible physicians completed the on-line survey (n = 61). Eight physicians were invited and seven completed the think aloud test. Overall satisfaction with the system was moderate. Usability was identified as a significant factor contributing to satisfaction. The major usability factors identified were system response time and layout. The think aloud component identified additional factors beyond those identified in the on-line survey. This study found a modestly high level of physician satisfaction with a province-wide clinical critical care information system. Usability continues to be a significant factor in physician satisfaction. Using multiple methods of evaluation can capture the benefits of a large sample size and deeper understanding of the issues. Copyright © 2018 Elsevier B.V. All rights reserved.
Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J.; Nijsten, Maarten W.
2017-01-01
The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface. PMID:28800617
Doesburg, Frank; Cnossen, Fokie; Dieperink, Willem; Bult, Wouter; de Smet, Anne Marie; Touw, Daan J; Nijsten, Maarten W
2017-01-01
The objective of this study was to assess the usability benefits of adding a bedside central control interface that controls all intravenous (IV) infusion pumps compared to the conventional individual control of multiple infusion pumps. Eighteen dedicated ICU nurses volunteered in a between-subjects task-based usability test. A newly developed central control interface was compared to conventional control of multiple infusion pumps in a simulated ICU setting. Task execution time, clicks, errors and questionnaire responses were evaluated. Overall the central control interface outperformed the conventional control in terms of fewer user actions (40±3 vs. 73±20 clicks, p<0.001) and fewer user errors (1±1 vs. 3±2 errors, p<0.05), with no difference in task execution times (421±108 vs. 406±119 seconds, not significant). Questionnaires indicated a significant preference for the central control interface. Despite being novice users of the central control interface, ICU nurses displayed improved performance with the central control interface compared to the conventional interface they were familiar with. We conclude that the new user interface has an overall better usability than the conventional interface.
von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice
2017-08-01
The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.
Zhang, Zhen; Franklin, Amy; Walji, Muhammad; Zhang, Jiajie; Gong, Yang
2014-01-01
EHR usability has been identified as a major barrier to care quality optimization. One major challenge of improving EHR usability is the lack of systematic training in usability or cognitive ergonomics for EHR designers/developers in the vendor community and EHR analysts making significant configurations in healthcare organizations. A practical solution is to provide usability inspection tools that can be easily operationalized by EHR analysts. This project is aimed at developing a set of usability tools with demonstrated validity and reliability. We present a preliminary study of a metric for cognitive transparency and an exploratory experiment testing its validity in predicting the effectiveness of action-effect mapping. Despite the pilot nature of both, we found high sensitivity and specificity of the metric and higher response accuracy within a shorter time for users to determine action-effect mappings in transparent user interface controls. We plan to expand the sample size in our empirical study. PMID:25954439
A Method for Automated Detection of Usability Problems from Client User Interface Events
Saadawi, Gilan M.; Legowski, Elizabeth; Medvedeva, Olga; Chavan, Girish; Crowley, Rebecca S.
2005-01-01
Think-aloud usability analysis provides extremely useful data but is very time-consuming and expensive to perform because of the extensive manual video analysis that is required. We describe a simple method for automated detection of usability problems from client user interface events for a developing medical intelligent tutoring system. The method incorporates (1) an agent-based method for communication that funnels all interface events and system responses to a centralized database, (2) a simple schema for representing interface events and higher order subgoals, and (3) an algorithm that reproduces the criteria used for manual coding of usability problems. A correction factor was empirically determining to account for the slower task performance of users when thinking aloud. We tested the validity of the method by simultaneously identifying usability problems using TAU and manually computing them from stored interface event data using the proposed algorithm. All usability problems that did not rely on verbal utterances were detectable with the proposed method. PMID:16779121
ERIC Educational Resources Information Center
Ku, David Tawei; Chang, Chia-Chi
2014-01-01
By conducting usability testing on a multilanguage Web site, this study analyzed the cultural differences between Taiwanese and American users in the performance of assigned tasks. To provide feasible insight into cross-cultural Web site design, Microsoft Office Online (MOO) that supports both traditional Chinese and English and contains an almost…
ERIC Educational Resources Information Center
Stevenson, Megan P.; Liu, Min
2010-01-01
This paper presents the results of an online survey and a usability test performed on three foreign language learning websites that use Web 2.0 technology. The online survey was conducted to gain an understanding of how current users of language learning websites use them for learning and social purposes. The usability test was conducted to gain…
Pervasive assistive technology for people with dementia: a UCD case
Rønn-Andersen, Kristoffer V.H.; Bień, Paulina; Özkil, Ali Gürcan; Forchhammer, Birgitte Hysse; Maier, Anja M.
2016-01-01
Smart mobile and wearable technology offers exciting opportunities to support people with dementia (PwD). Its ubiquity and popularity could even benefit user adoption – a great challenge for assistive technology (AT) for PwD that calls for user-centred design (UCD) methods. This study describes a user-centred approach to developing and testing AT based on off-the-shelf pervasive technologies. A prototype is created by combining a smartphone, smartwatch and various applications to offer six support features. This is tested among five end-users (PwD) and their caregivers. Controlled usability testing was followed by field testing in a real-world context. Data is gathered from video recordings, interaction logs, system usability scale questionnaires, logbooks, application usage logs and interviews structured on the unified theory of acceptance and use of technology model. The data is analysed to evaluate usability, usefulness and user acceptance. Results show some promise for user adoption, but highlight challenges to be overcome, emphasising personalisation and familiarity as key considerations. The complete findings regarding usability issues, usefulness of support features and four identified adoption profiles are used to provide a set of recommendations for practitioners and further research. These contribute toward UCD practices for improved smart, pervasive AT for dementia. PMID:28008366
Virtually Usable: A Test of the Information Gardens
ERIC Educational Resources Information Center
Johnson, Megan; Ochoa, Louise; Purpur, Geraldine
2007-01-01
This paper presents the results of a usability study conducted to determine the functionality of a desktop, three-dimensional virtual library designed and supported by the Appalachian State University Distance Learning Library Services team. Formative evaluations were performed with representative students utilizing Morae software. Results…
A virtual reality test battery for assessment and screening of spatial neglect.
Fordell, H; Bodin, K; Bucht, G; Malm, J
2011-03-01
There is a need for improved screening methods for spatial neglect. To construct a VR-test battery and evaluate its accuracy and usability in patients with acute stroke. VR-DiSTRO consists of a standard desktop computer, a CRT monitor and eye shutter stereoscopic glasses, a force feedback interface, and software, developed to create an interactive and immersive 3D experience. VR-tests were developed and validated to the conventional Star Cancellation test, Line bisection, Baking Tray Task (BTT), and Visual Extinction test. A construct validation to The Rivermead Behavioral Inattention Test, used as criterion of visuospatial neglect, was made. Usability was assessed according to ISO 9241-11. Thirty-one patients with stroke were included, 9/31 patients had neglect. The sensitivity was 100% and the specificity 82% for the VR-DiSTRO to correctly identify neglect. VR-BTT and VR-Extinction had the highest correlation (r² = 0.64 and 0.78), as well as high sensitivity and specificity. The kappa values describing the agreement between traditional neglect tests and the corresponding virtual reality test were between 0.47-0.85. Usability was assessed by a questionnaire; 77% reported that the VR-DiSTRO was 'easy' to use. Eighty-eight percent reported that they felt 'focused', 'pleased' or 'alert'. No patient had adverse symptoms. The test session took 15 min. The VR-DiSTRO quickly and with a high accuracy identified visuospatial neglect in patients with stroke in this construct validation. The usability among elderly patients with stroke was high. This VR-test battery has the potential to become an important screening instrument for neglect and a valuable adjunct to the neuropsychological assessment. © 2010 John Wiley & Sons A/S.
A Human Reliability Based Usability Evaluation Method for Safety-Critical Software
DOE Office of Scientific and Technical Information (OSTI.GOV)
Phillippe Palanque; Regina Bernhaupt; Ronald Boring
2006-04-01
Recent years have seen an increasing use of sophisticated interaction techniques including in the field of safety critical interactive software [8]. The use of such techniques has been required in order to increase the bandwidth between the users and systems and thus to help them deal efficiently with increasingly complex systems. These techniques come from research and innovation done in the field of humancomputer interaction (HCI). A significant effort is currently being undertaken by the HCI community in order to apply and extend current usability evaluation techniques to these new kinds of interaction techniques. However, very little has been donemore » to improve the reliability of software offering these kinds of interaction techniques. Even testing basic graphical user interfaces remains a challenge that has rarely been addressed in the field of software engineering [9]. However, the non reliability of interactive software can jeopardize usability evaluation by showing unexpected or undesired behaviors. The aim of this SIG is to provide a forum for both researchers and practitioners interested in testing interactive software. Our goal is to define a roadmap of activities to cross fertilize usability and reliability testing of these kinds of systems to minimize duplicate efforts in both communities.« less
Polymer membranes as separators for supercapacitors
NASA Astrophysics Data System (ADS)
Szubzda, Bronisław; Szmaja, Aleksandra; Ozimek, Mariusz; Mazurkiewicz, Sławomir
2014-12-01
The purpose of the studies described was to examine the influence of low-energy plasma modification of polyamide and polypropylene polymer nonwoven fabrics on the usable properties of supercapacitors when using these fabrics as the separator material. To achieve this goal the following investigations were carried out: testing the time required for electrolyte saturation of separators and the conductivity of the electrolyte contained in the separator, as well as electrochemical examinations of supercapacitor models in which the modified fabric separators were used. The tests conducted fully confirm the usability of this modification for cleaning the surface and improving the wettability of separators by the electrolyte, which in turn results in a significant decrease of the internal resistance of the supercapacitor, thus increasing the usable power of the device.
A study in usability: redesigning a health sciences library's mobile site.
Rosario, Jovy-Anne; Ascher, Marie T; Cunningham, Diana J
2012-01-01
A mobile site redesign was conducted at a medium-sized academic health sciences library with the goal of creating a site that meets the mobile information needs of its users. The redesign phases included (1) needs assessment, (2) usability testing, and (3) site design. The survey results showed that Apple devices were the most prevalent; the most desirable activities performed on a mobile site were searching for articles, accessing full-text articles and e-books, searching databases, and searching the catalog. These activities guided the development of the usability testing tasks and the redesign. All phases were completed within six months, and the total project cost was $50 for incentive purchases. Copyright © Taylor & Francis Group, LLC
Orlosky, Jason; Itoh, Yuta; Ranchet, Maud; Kiyokawa, Kiyoshi; Morgan, John; Devos, Hannes
2017-04-01
For neurodegenerative conditions like Parkinson's disease, early and accurate diagnosis is still a difficult task. Evaluations can be time consuming, patients must often travel to metropolitan areas or different cities to see experts, and misdiagnosis can result in improper treatment. To date, only a handful of assistive or remote methods exist to help physicians evaluate patients with suspected neurological disease in a convenient and consistent way. In this paper, we present a low-cost VR interface designed to support evaluation and diagnosis of neurodegenerative disease and test its use in a clinical setting. Using a commercially available VR display with an infrared camera integrated into the lens, we have constructed a 3D virtual environment designed to emulate common tasks used to evaluate patients, such as fixating on a point, conducting smooth pursuit of an object, or executing saccades. These virtual tasks are designed to elicit eye movements commonly associated with neurodegenerative disease, such as abnormal saccades, square wave jerks, and ocular tremor. Next, we conducted experiments with 9 patients with a diagnosis of Parkinson's disease and 7 healthy controls to test the system's potential to emulate tasks for clinical diagnosis. We then applied eye tracking algorithms and image enhancement to the eye recordings taken during the experiment and conducted a short follow-up study with two physicians for evaluation. Results showed that our VR interface was able to elicit five common types of movements usable for evaluation, physicians were able to confirm three out of four abnormalities, and visualizations were rated as potentially useful for diagnosis.
A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care.
Bakhshi-Raiez, F; de Keizer, N F; Cornet, R; Dorrepaal, M; Dongelmans, D; Jaspers, M W M
2012-05-01
To evaluate the usability of a large compositional interface terminology based on SNOMED CT and the terminology application for registration of the reasons for intensive care admission in a Patient Data Management System. Observational study with user-based usability evaluations before and 3 months after the system was implemented and routinely used. Usability was defined by five aspects: effectiveness, efficiency, learnability, overall user satisfaction, and experienced usability problems. Qualitative (the Think-Aloud user testing method) and quantitative (the System Usability Scale questionnaire and Time-on-Task analyses) methods were used to examine these usability aspects. The results of the evaluation study revealed that the usability of the interface terminology fell short (SUS scores before and after implementation of 47.2 out of 100 and 37.5 respectively out of 100). The qualitative measurements revealed a high number (n=35) of distinct usability problems, leading to ineffective and inefficient registration of reasons for admission. The effectiveness and efficiency of the system did not change over time. About 14% (n=5) of the revealed usability problems were related to the terminology content based on SNOMED CT, while the remaining 86% (n=30) was related to the terminology application. The problems related to the terminology content were more severe than the problems related to the terminology application. This study provides a detailed insight into how clinicians interact with a controlled compositional terminology through a terminology application. The extensiveness, complexity of the hierarchy, and the language usage of an interface terminology are defining for its usability. Carefully crafted domain-specific subsets and a well-designed terminology application are needed to facilitate the use of a complex compositional interface terminology based on SNOMED CT. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.
NASA Astrophysics Data System (ADS)
Rosati, A.; Yarmey, L.
2014-12-01
It is well understood that a good data scientist needs domain science, analysis, programming, and communication skills to create finished data products, visualizations, and reports. Articles and blogs tout the need for "expert" skill levels in domain knowledge, statistics, storytelling, graphic design, technology…and the list goes on. Since it seems impossible that one person would encompass all these skills, it is often suggested that data science be done by a team instead of an individual. This research into, and experience with, data product design offers an augmented definition - one that elevates relationships and engagement with the final user of a product. Essentially, no matter how fantastic or technically advanced a product appears, the intended audience of that product must be able to understand, use, and find value in the product in order for it to be considered a success. Usability is often misunderstood and seen as common sense or common knowledge, but it is actually an important and challenging piece of product development. This paper describes the National Snow and Ice Data Center's process to usability test the Arctic Data Explorer (ADE). The ADE is a federated data search tool for interdisciplinary Arctic science data that has been improved in features, appearance, functionality, and quality through a series of strategic and targeted usability testing and assessments. Based on the results, it is recommended that usability testing be incorporated into the skill set of each data science team.
Development and testing of painometer: a smartphone app to assess pain intensity.
de la Vega, Rocío; Roset, Roman; Castarlenas, Elena; Sánchez-Rodríguez, Elisabet; Solé, Ester; Miró, Jordi
2014-10-01
Electronic and information technologies are increasingly being used to assess pain. This study aims to 1) introduce Painometer, a smartphone app that helps users to assess pain intensity, and 2) report on its usability (ie, user performance and satisfaction) and acceptability (ie, the willingness to use it) when it is made available to health care professionals and nonprofessionals. Painometer includes 4 well-known pain intensity scales: the Faces Pain Scale-Revised, the numerical rating scale-11, the Coloured Analogue Scale, and the visual analog scale. Scores reported with these scales, when used in their traditional format, have shown to be valid and reliable. The app was tested in a sample of 24 health care professionals and 30 nonprofessionals. Two iterative usability cycles were conducted with a qualitative usability testing approach and a semistructured interview. The participants had an average of 10 years' experience in using computers. The domains measured were ease of use, errors in usage, most popular characteristics, suggested changes, and acceptability. Adding instructions and changing format and layout details solved the usability problems reported in cycle 1. No further problems were reported in cycle 2. Painometer has been found to be a useful, user-friendly app that may help to improve the accuracy of pain intensity assessment. Painometer, a smartphone app to assess pain intensity, shows good usability and acceptability properties when used by health care professionals and nonprofessionals. Copyright © 2014 American Pain Society. Published by Elsevier Inc. All rights reserved.
Evaluation of Smartphone Applications for Cardiopulmonary Resuscitation Training in South Korea
Cho, Yongtak; Song, Yeongtak; Lim, Tae Ho; Kang, Hyunggoo
2016-01-01
Objective. There are many smartphone-based applications (apps) for cardiopulmonary resuscitation (CPR) training. We investigated the conformity and the learnability/usability of these apps for CPR training and real-life supports. Methods. We conducted a mixed-method, sequential explanatory study to assess CPR training apps downloaded on two apps stores in South Korea. Apps were collected with inclusion criteria as follows, Korean-language instruction, training features, and emergency supports for real-life incidents, and analyzed with two tests; 15 medical experts evaluated the apps' contents according to current Basic Life Support guidelines in conformity test, and 15 nonmedical individuals examined the apps using System Usability Scale (SUS) in the learnability/usability test. Results. Out of 79 selected apps, five apps were included and analyzed. For conformity (ICC, 0.95, p < 0.001), means of all apps were greater than 12 of 20 points, indicating that they were well designed according to current guidelines. Three of the five apps yielded acceptable level (greater than 68 of 100 points) for learnability/usability. Conclusion. All the included apps followed current BLS guidelines and a majority offered acceptable learnability/usability for layperson. Current and developmental smartphone-based CPR training apps should include accurate CPR information and be easy to use for laypersons that are potential rescuers in real-life incidents. For Clinical Trials. This is a clinical trial, registered at the Clinical Research Information Service (CRIS, cris.nih.go.kr), number KCT0001840. PMID:27668257
Schmettow, Martin; Schnittker, Raphaela; Schraagen, Jan Maarten
2017-05-01
This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences and derive performance measures. Secondly, a prevailing focus on cross-sectional validation studies, ignoring the issues of learnability and training. The U.S. Federal Drug and Food Administration's recent proposal for a validation testing protocol for medical devices is then extended to address these shortcomings: (1) a novel process measure 'normative path deviations' is introduced that is useful for both quantitative and qualitative usability studies and (2) a longitudinal, completely within-subject study design is presented that assesses learnability, training effects and allows analysis of diversity of users. A reference regression model is introduced to analyze data from this and similar studies, drawing upon generalized linear mixed-effects models and a Bayesian estimation approach. The extended protocol is implemented and demonstrated in a study comparing a novel syringe infusion pump prototype to an existing design with a sample of 25 healthcare professionals. Strong performance differences between designs were observed with a variety of usability measures, as well as varying training-on-the-job effects. We discuss our findings with regard to validation testing guidelines, reflect on the extensions and discuss the perspectives they add to the validation process. Copyright © 2017 Elsevier Inc. All rights reserved.
NASA Astrophysics Data System (ADS)
Klein, Laura M.; McNamara, Laura A.
2017-05-01
In this paper, we address the needed components to create usable engineering and operational user interfaces (UIs) for airborne Synthetic Aperture Radar (SAR) systems. As airborne SAR technology gains wider acceptance in the remote sensing and Intelligence, Surveillance, and Reconnaissance (ISR) communities, the need for effective and appropriate UIs to command and control these sensors has also increased. However, despite the growing demand for SAR in operational environments, the technology still faces an adoption roadblock, in large part due to the lack of effective UIs. It is common to find operational interfaces that have barely grown beyond the disparate tools engineers and technologists developed to demonstrate an initial concept or system. While sensor usability and utility are common requirements to engineers and operators, their objectives for interacting with the sensor are different. As such, the amount and type of information presented ought to be tailored to the specific application.
Durand, Marie-Anne; Alam, Shama; Grande, Stuart W; Elwyn, Glyn
2016-01-01
Objective Women of low socioeconomic status (SES) diagnosed with early stage breast cancer experience decision-making, treatment and outcome disparities. Evidence suggests that decision aids can benefit underserved patients, when tailored to their needs. Our aim was to develop and test the usability, acceptability and accessibility of a pictorial encounter decision aid targeted at women of low SES diagnosed with early stage breast cancer. Design Community-based participatory research (CBPR) using think-aloud protocols (phases 1 and 2) and semistructured interviews (phase 3). Setting Underserved community settings (eg, knitting groups, bingo halls, senior centres) and breast clinics. Participants In phase 1, we recruited a convenience sample of clinicians and academics. In phase 2, we targeted women over 40 years of age, of low SES, regardless of breast cancer history, and in phase 3, women of low SES, recently diagnosed with breast cancer. Intervention The pictorial encounter decision aid was derived from an evidence-based table comparing treatment options for breast cancer (http://www.optiongrid.org). Outcome measures We assessed the usability, acceptability and accessibility of the pictorial decision aid prototypes using the think-aloud protocol and semistructured interviews. Results After initial testing of the first prototype with 18 academics and health professionals, new versions were developed and tested with 53 lay individuals in community settings. Usability was high. In response to feedback indicating that the use of cartoon characters was considered insensitive, a picture-only version was developed and tested with 23 lay people in phase 2, and 10 target users in phase 3. Conclusions and relevance Using CBPR methods and iterative user testing cycles improved usability and accessibility, and led to the development of the Picture Option Grid, entirely guided by multiple stakeholder feedback. All women of low SES recently diagnosed with early stage breast cancer found the Picture Option Grid usable, acceptable and accessible. PMID:26839014
Enhancing the usability of CRT displays in test flight monitoring
NASA Astrophysics Data System (ADS)
Granaas, Michael M.; Sredinski, Victoria E.
1991-01-01
Enhancing the usability of Mission Control Center (MCC) CRT displays stands to improve the quality, productivity, and safety of flight-test research at the NASA Ames-Dryden Flight Research Facility. The results of this research suggests that much can be done to assist the user and improve the quality of flight research through the enhancement of current displays. This research has applications to a variety of flight data monitoring displays.
Usability test of KNRC self-feeding robot.
Song, Won-Kyung; Song, Won-Jin; Kim, Yale; Kim, Jongbae
2013-06-01
Various assistive robots for supporting the activities of daily living have been developed. However, not many of these have been introduced into the market because they were found to be impractical in actual scenarios. In this paper, we report on the usability test results of an assistive robot designed for self-feeding for people having disabilities, which includes those having spinal cord injury, cerebral palsy, and traumatic brain injury. First, we present three versions of a novel self-feeding robot (KNRC self-feeding robot), which is suitable for use with Korean food, including sticky rice. These robots have been improved based on participatory action design over a period of three years. Next, we discuss the usability tests of the KNRC self-feeding robots. People with disabilities participated in comparative tests between the KNRC self-feeding robot and the commercialized product named My Spoon. The KNRC self-feeding robot showed positive results in relation to satisfaction and performance compared to the commercialized robot when users ate Korean food, including sticky rice.
Usability Testing as a Method to Refine a Health Sciences Library Website.
Denton, Andrea H; Moody, David A; Bennett, Jason C
2016-01-01
User testing, a method of assessing website usability, can be a cost-effective and easily administered process to collect information about a website's effectiveness. A user experience (UX) team at an academic health sciences library has employed user testing for over three years to help refine the library's home page. Test methodology used in-person testers using the "think aloud" method to complete tasks on the home page. Review of test results revealed problem areas of the design and redesign; further testing was effective in refining the page. User testing has proved to be a valuable method to engage users and provide feedback to continually improve the library's home page.
Monkman, Helen; Griffith, Janessa; Kushniruk, Andre W
2015-01-01
Heuristic evaluations have proven to be valuable for identifying usability issues in systems. Commonly used sets of heuritics exist; however, they may not always be the most suitable, given the specific goal of the analysis. One such example is seeking to evaluate the demands on eHealth literacy and usability of consumer health information systems. In this study, eight essential heuristics and three optional heuristics subsumed from the evidence on eHealth/health literacy and usability were tested for their utility in assessing a mobile blood pressure tracking application (app). This evaluation revealed a variety of ways the design of the app could both benefit and impede users with limited eHealth literacy. This study demonstrated the utility of a low-cost, single evaluation approach for identifying both eHealth literacy and usability issues based on existing evidence in the literature.
A review of ultra-short pulse lasers for military remote sensing and rangefinding
NASA Astrophysics Data System (ADS)
Lamb, Robert A.
2009-09-01
Advances in ultra-short pulse laser technology have resulted in commercially available laser systems capable of generating high peak powers >1GW in tabletop systems. This opens the prospect of generating very wide spectral emissions with a combination of non-linear optical effects in photonic crystal fibres to produce supercontinuua in systems that are readily accessible to military applications. However, military remote sensing rarely requires bandwidths spanning two octaves and it is clear that efficient systems require controlled spectral emission in relevant bands. Furthermore, the limited spectral responsivity of focal plane arrays may impose further restriction on the usable spectrum. A recent innovation which temporally encodes a spectrum using group velocity dispersion allows detection with a photodiode, opening the prospect for high speed hyperspectral sensing and imaging. At the opposite end of the power spectrum, ultra-low power remote sensing using time-correlated single photon counting (SPC) has reduced the laser power requirement and demonstrated remote sensing over 5km during daylight with repetition rates of ~10MHz with ps pulses. Recent research has addressed uncorrelated SPC and waveform transmission to increase data rates for absolute rangefinding whilst avoiding range aliasing. This achievement opens the prospect of combining SPC with high repetition rate temporal encoding of supercontinuua to realise practical hyperspectral remote sensing lidar. The talk will present an overview of these technologies and present a concept which combines them into a single system for high-speed hyperspectral imaging and remote sensing.
Remote Data Exploration with the Interactive Data Language (IDL)
NASA Technical Reports Server (NTRS)
Galloy, Michael
2013-01-01
A difficulty for many NASA researchers is that often the data to analyze is located remotely from the scientist and the data is too large to transfer for local analysis. Researchers have developed the Data Access Protocol (DAP) for accessing remote data. Presently one can use DAP from within IDL, but the IDL-DAP interface is both limited and cumbersome. A more powerful and user-friendly interface to DAP for IDL has been developed. Users are able to browse remote data sets graphically, select partial data to retrieve, import that data and make customized plots, and have an interactive IDL command line session simultaneous with the remote visualization. All of these IDL-DAP tools are usable easily and seamlessly for any IDL user. IDL and DAP are both widely used in science, but were not easily used together. The IDL DAP bindings were incomplete and had numerous bugs that prevented their serious use. For example, the existing bindings did not read DAP Grid data, which is the organization of nearly all NASA datasets currently served via DAP. This project uniquely provides a fully featured, user-friendly interface to DAP from IDL, both from the command line and a GUI application. The DAP Explorer GUI application makes browsing a dataset more user-friendly, while also providing the capability to run user-defined functions on specified data. Methods for running remote functions on the DAP server were investigated, and a technique for accomplishing this task was decided upon.
Wolpin, S E; Halpenny, B; Whitman, G; McReynolds, J; Stewart, M; Lober, W B; Berry, D L
2015-03-01
The feasibility and acceptability of computerized screening and patient-reported outcome measures have been demonstrated in the literature. However, patient-centered management of health information entails two challenges: gathering and presenting data using "patient-tailored" methods and supporting "patient-control" of health information. The design and development of many symptom and quality-of-life information systems have not included opportunities for systematically collecting and analyzing user input. As part of a larger clinical trial, the Electronic Self-Report Assessment for Cancer-II project, participatory design approaches were used to build and test new features and interfaces for patient/caregiver users. The research questions centered on patient/caregiver preferences with regard to the following: (a) content, (b) user interface needs, (c) patient-oriented summary, and (d) patient-controlled sharing of information with family, caregivers, and clinicians. Mixed methods were used with an emphasis on qualitative approaches; focus groups and individual usability tests were the primary research methods. Focus group data were content analyzed, while individual usability sessions were assessed with both qualitative and quantitative methods. We identified 12 key patient/caregiver preferences through focus groups with 6 participants. We implemented seven of these preferences during the iterative design process. We deferred development for some of the preferences due to resource constraints. During individual usability testing (n = 8), we were able to identify 65 usability issues ranging from minor user confusion to critical errors that blocked task completion. The participatory development model that we used led to features and design revisions that were patient centered. We are currently evaluating new approaches for the application interface and for future research pathways. We encourage other researchers to adopt user-centered design approaches when building patient-centered technologies. © The Author(s) 2014.
Docking, Rachael E; Lane, Matthew; Schofield, Pat A
2017-03-15
Pain assessment in older adults with cognitive impairment is often challenging, and paramedics are not given sufficient tools/training to assess pain. The development of a mobile app may improve pain assessment and management in this vulnerable population. We conducted usability testing of a newly developed iPhone pain assessment application with potential users, in this case as a tool for clinical paramedic practice to improve pain assessment of older adults with cognitive impairment. We conducted usability testing with paramedic students and a Delphi panel of qualified paramedics. Participants studied the app and paper-based algorithm from which the app was developed. The potential use for the app was discussed. Usability testing focus groups were recorded, transcribed verbatim, and analyzed using a thematic approach. Proposed recommendations were disseminated to the Delphi panel that reviewed and confirmed them. Twenty-four paramedic students from two UK ambulance services participated in the focus groups. Usability of the app and its potential were viewed positively. Four major themes were identified: 1) overall opinion of the app for use in paramedic services; 2) incorporating technological applications into the health care setting; 3) improving knowledge and governance; and 4) alternative uses for the app. Subthemes were identified and are presented. Our results indicate that the pain assessment app constitutes a potentially useful tool in the prehospital setting. By providing access to a tool specifically developed to help identify/assess pain in a user-friendly format, paramedics are likely to have increased knowledge and confidence in assessing pain in patients with dementia. © 2017 American Academy of Pain Medicine. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com
ERIC Educational Resources Information Center
Crowther, Michael S.; Keller, Chris C.; Waddoups, Gregory L.
2004-01-01
Brigham Young University's Center for Instructional Design (CID) creates online courses and multimedia instructional applications for university faculty. This paper asserts that including usability testing as a part of evaluation improves the quality and effectiveness of computer-mediated instruction. The paper describes the fundamental purpose…
ERIC Educational Resources Information Center
McMillen, Paula S.; Pehrsson, Dale-Elizabeth
2009-01-01
Technology proficiency expectations have proliferated in counselor education; however, limited information in the counseling literature details how to effectively evaluate or refine online resources from a design/utility standpoint. This description of a small-scale usability study demonstrates a cost-effective strategy for improving counselor…
User Satisfaction Evaluation of an Educational Website
ERIC Educational Resources Information Center
Akilli, Goknur Kaplan
2005-01-01
This study focuses on one particular aspect of usability, namely, user satisfaction, for an educational website used as a supportive tool for various courses by employing only one specific usability testing technique, a questionnaire. The researcher aimed to find out whether eighth semester undergraduate students of Computer Education and…
FACT - Status and experience from five years of operation of the first G-APD Cherenkov Telescope
NASA Astrophysics Data System (ADS)
Neise, D.; Adam, J.; Ahnen, M. L.; Baack, D.; Balbo, M.; Bergmann, M.; Biland, A.; Blank, M.; Bretz, T.; Brügge, K. A.; Buss, J.; Dmytriiev, A.; Dorner, D.; Einecke, S.; Hempfling, C.; Hildebrand, D.; Hughes, G.; Linhoff, L.; Mannheim, K.; Müller, S.; Neronov, A.; Nöthe, M.; Paravac, A.; Pauss, F.; Rhode, W.; Shukla, A.; Temme, F.; Thaele, J.; Walter, R.
2017-12-01
The First G-APD Cherenkov Telescope (FACT) demonstrates the usability of novel Geiger-mode operated Avalanche Photo Diodes (G-APD, often called SiPM) for Imaging Atmospheric Cherenkov Telescopes (IACT). The camera consists of 1440 pixels with dedicated electronics operating at 2 Giga samples per second. It is installed on the refurbished HEGRA telescope with a mirror area of ≈ 9.5m2 on the Canary Island La Palma. FACT is taking data almost every night since the camera was installed in October 2011. It was possible to improve the data taking efficiency to very high values due to the very stable and reliable operation. This also allows to operate FACT remotely without any need for operators on site. Even remote human intervention became less and less frequent over the years, allowing operation to become mostly automatic. FACT is monitoring the long-term behavior of some very-high energy variable extra-galactic sources with unparalleled sampling density as well as testing the behavior of the sensors under severe weather conditions. Due to the long exposure of FACT's G-APDs under strong moonlight conditions it was possible to evaluate the aging effects of G-APDs due to collected charge. No indication of aging was found. No external calibration device is needed to operate FACT since the properties of the sensors themselves allow for a high precision self-calibration of the camera.
Evaluating a Web-Based Interface for Internet Telemedicine
NASA Technical Reports Server (NTRS)
Lathan, Corinna E.; Newman, Dava J.; Sebrechts, Marc M.; Doarn, Charles R.
1997-01-01
The objective is to introduce the usability engineering methodology, heuristic evaluation, to the design and development of a web-based telemedicine system. Using a set of usability criteria, or heuristics, one evaluator examined the Spacebridge to Russia web-site for usability problems. Thirty-four usability problems were found in this preliminary study and all were assigned a severity rating. The value of heuristic analysis in the iterative design of a system is shown because the problems can be fixed before deployment of a system and the problems are of a different nature than those found by actual users of the system. It was therefore determined that there is potential value of heuristic evaluation paired with user testing as a strategy for optimal system performance design.
Design of affordable and ruggedized biomedical devices using virtual instrumentation.
Mathern, Ryan Michael; Schopman, Sarah; Kalchthaler, Kyle; Mehta, Khanjan; Butler, Peter
2013-05-01
Abstract This paper presents the designs of four low-cost and ruggedized biomedical devices, including a blood pressure monitor, thermometer, weighing scale and spirometer, designed for the East African context. The design constraints included a mass-production price point of $10, accuracy and precision comparable to commercial devices and ruggedness to function effectively in the harsh environment of East Africa. The blood pressure device, thermometer and weighing scale were field-tested in Kenya and each recorded data within 6% error of the measurements from commercial devices and withstood the adverse climate and rough handling. The spirometer functioned according to specifications, but a re-design is needed to improve operability and usability by patients. This article demonstrates the feasibility of designing and commercializing virtual instrumentation-based biomedical devices in resource-constrained environments through context-driven design. The next steps for the devices include designing them such that they can be more easily manufactured, use standardized materials, are easily calibrated in the field and have more user-friendly software programs that can be updated remotely.
Fay, Nicolas; Ellison, T. Mark
2013-01-01
This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both), and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity), but harder to learn (identification accuracy) for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs) is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability. PMID:23967243
Fay, Nicolas; Ellison, T Mark
2013-01-01
This study examines the intergenerational transfer of human communication systems. It tests if human communication systems evolve to be easy to learn or easy to use (or both), and how population size affects learnability and usability. Using an experimental-semiotic task, we find that human communication systems evolve to be easier to use (production efficiency and reproduction fidelity), but harder to learn (identification accuracy) for a second generation of naïve participants. Thus, usability trumps learnability. In addition, the communication systems that evolve in larger populations exhibit distinct advantages over those that evolve in smaller populations: the learnability loss (from the Initial signs) is more muted and the usability benefits are more pronounced. The usability benefits for human communication systems that evolve in a small and large population is explained through guided variation reducing sign complexity. The enhanced performance of the communication systems that evolve in larger populations is explained by the operation of a content bias acting on the larger pool of competing signs. The content bias selects for information-efficient iconic signs that aid learnability and enhance usability.
Automatic Assessment of Acquisition and Transmission Losses in Indian Remote Sensing Satellite Data
NASA Astrophysics Data System (ADS)
Roy, D.; Purna Kumari, B.; Manju Sarma, M.; Aparna, N.; Gopal Krishna, B.
2016-06-01
The quality of Remote Sensing data is an important parameter that defines the extent of its usability in various applications. The data from Remote Sensing satellites is received as raw data frames at the ground station. This data may be corrupted with data losses due to interferences during data transmission, data acquisition and sensor anomalies. Thus it is important to assess the quality of the raw data before product generation for early anomaly detection, faster corrective actions and product rejection minimization. Manual screening of raw images is a time consuming process and not very accurate. In this paper, an automated process for identification and quantification of losses in raw data like pixel drop out, line loss and data loss due to sensor anomalies is discussed. Quality assessment of raw scenes based on these losses is also explained. This process is introduced in the data pre-processing stage and gives crucial data quality information to users at the time of browsing data for product ordering. It has also improved the product generation workflow by enabling faster and more accurate quality estimation.
Boulos, Maged N Kamel; Honda, Kiyoshi
2006-01-01
Open Source Web GIS software systems have reached a stage of maturity, sophistication, robustness and stability, and usability and user friendliness rivalling that of commercial, proprietary GIS and Web GIS server products. The Open Source Web GIS community is also actively embracing OGC (Open Geospatial Consortium) standards, including WMS (Web Map Service). WMS enables the creation of Web maps that have layers coming from multiple different remote servers/sources. In this article we present one easy to implement Web GIS server solution that is based on the Open Source University of Minnesota (UMN) MapServer. By following the accompanying step-by-step tutorial instructions, interested readers running mainstream Microsoft® Windows machines and with no prior technical experience in Web GIS or Internet map servers will be able to publish their own health maps on the Web and add to those maps additional layers retrieved from remote WMS servers. The 'digital Asia' and 2004 Indian Ocean tsunami experiences in using free Open Source Web GIS software are also briefly described. PMID:16420699
Interface evaluation for soft robotic manipulators
NASA Astrophysics Data System (ADS)
Moore, Kristin S.; Rodes, William M.; Csencsits, Matthew A.; Kwoka, Martha J.; Gomer, Joshua A.; Pagano, Christopher C.
2006-05-01
The results of two usability experiments evaluating an interface for the operation of OctArm, a biologically inspired robotic arm modeled after an octopus tentacle, are reported. Due to the many degrees-of-freedom (DOF) for the operator to control, such 'continuum' robotic limbs provide unique challenges for human operators because they do not map intuitively. Two modes have been developed to control the arm and reduce the DOF under the explicit direction of the operator. In coupled velocity (CV) mode, a joystick controls changes in arm curvature. In end-effector (EE) mode, a joystick controls the arm by moving the position of an endpoint along a straight line. In Experiment 1, participants used the two modes to grasp objects placed at different locations in a virtual reality modeling language (VRML). Objective measures of performance and subjective preferences were recorded. Results revealed lower grasp times and a subjective preference for the CV mode. Recommendations for improving the interface included providing additional feedback and implementation of an error recovery function. In Experiment 2, only the CV mode was tested with improved training of participants and several changes to the interface. The error recovery function was implemented, allowing participants to reverse through previously attained positions. The mean time to complete the trials in the second usability test was reduced by more than 4 minutes compared with the first usability test, confirming the interface changes improved performance. The results of these tests will be incorporated into future versions of the arm and improve future usability tests.
Mims electron-nuclear double resonance in LiYF4:Ce3+ crystal
NASA Astrophysics Data System (ADS)
Gafurov, M.; Mamin, G.; Kurkin, I.; Orlinskii, S.
2018-05-01
We report the observation of the pulsed electron-nuclear double resonance (ENDOR) spectra from 19F and 7Li nuclei on impurity Ce3+ ions in LiYF4 crystal. The resolved structure from the nearby and remote nuclei in spectra is observed. The outcome shows that LiYF4:Ce3+ system can be exploited as a convenient matrix for performing spin manipulations and adjusting quantum computation protocols while ENDOR technique is usable for the investigation of electron-nuclear interaction with all the nuclei of the system.
NASA planetary data: applying planetary satellite remote sensing data in the classroom
NASA Technical Reports Server (NTRS)
Liggett, P.; Dobinson, E.; Sword, B.; Hughes, D.; Martin, M.; Martin, D.
2002-01-01
NASA supports several data archiving and distribution mechanisms that provide a means whereby scientists can participate in education and outreach through the use of technology for data and information dissemination. The Planetary Data System (PDS) is sponsored by NASA's Office of Space Science. Its purpose is to ensure the long-term usability of NASA data and to stimulate advanced research. In addition, the NASA Regional Planetary Image Facility (RPIF), an international system of planetary image libraries, maintains photographic and digital data as well as mission documentation and cartographic data.
A Secure Mobile-Based Authentication System for e-Banking
NASA Astrophysics Data System (ADS)
Rifà-Pous, Helena
Financial information is extremely sensitive. Hence, electronic banking must provide a robust system to authenticate its customers and let them access their data remotely. On the other hand, such system must be usable, affordable, and portable. We propose a challenge-response based one-time password (OTP) scheme that uses symmetric cryptography in combination with a hardware security module. The proposed protocol safeguards passwords from keyloggers and phishing attacks. Besides, this solution provides convenient mobility for users who want to bank online anytime and anywhere, not just from their own trusted computers.
Solana, Javier; Cáceres, César; García-Molina, Alberto; Opisso, Eloy; Roig, Teresa; Tormos, José M; Gómez, Enrique J
2015-01-01
Cognitive rehabilitation aims to remediate or alleviate the cognitive deficits appearing after an episode of acquired brain injury (ABI). The purpose of this work is to describe the telerehabilitation platform called Guttmann Neuropersonal Trainer (GNPT) which provides new strategies for cognitive rehabilitation, improving efficiency and access to treatments, and to increase knowledge generation from the process. A cognitive rehabilitation process has been modeled to design and develop the system, which allows neuropsychologists to configure and schedule rehabilitation sessions, consisting of set of personalized computerized cognitive exercises grounded on neuroscience and plasticity principles. It provides remote continuous monitoring of patient's performance, by an asynchronous communication strategy. An automatic knowledge extraction method has been used to implement a decision support system, improving treatment customization. GNPT has been implemented in 27 rehabilitation centers and in 83 patients' homes, facilitating the access to the treatment. In total, 1660 patients have been treated. Usability and cost analysis methodologies have been applied to measure the efficiency in real clinical environments. The usability evaluation reveals a system usability score higher than 70 for all target users. The cost efficiency study results show a relation of 1-20 compared to face-to-face rehabilitation. GNPT enables brain-damaged patients to continue and further extend rehabilitation beyond the hospital, improving the efficiency of the rehabilitation process. It allows customized therapeutic plans, providing information to further development of clinical practice guidelines.
Advanced methods for displays and remote control of robots.
Eliav, Ami; Lavie, Talia; Parmet, Yisrael; Stern, Helman; Edan, Yael
2011-11-01
An in-depth evaluation of the usability and situation awareness performance of different displays and destination controls of robots are presented. In two experiments we evaluate the way information is presented to the operator and assess different means for controlling the robot. Our study compares three types of displays: a "blocks" display, a HUD (head-up display), and a radar display, and two types of controls: touch screen and hand gestures. The HUD demonstrated better performance when compared to the blocks display and was perceived to have greater usability compared to the radar display. The HUD was also found to be more useful when the operation of the robot was more difficult, i.e., when using the hand-gesture method. The experiments also pointed to the importance of using a wide viewing angle to minimize distortion and for easier coping with the difficulties of locating objects in the field of view margins. The touch screen was found to be superior in terms of both objective performance and its perceived usability. No differences were found between the displays and the controllers in terms of situation awareness. This research sheds light on the preferred display type and controlling method for operating robots from a distance, making it easier to cope with the challenges of operating such systems. Copyright © 2011 Elsevier Ltd and The Ergonomics Society. All rights reserved.
Psychological Usability of Layered Application Software Platforms
NASA Technical Reports Server (NTRS)
Uhiarik, John
1999-01-01
This grant provided Graduate Research Fellowship Program support to James Michael Herold to obtain a graduate degree from the Department of Psychology at Kansas State University and conduct usability testing of graphical user interfaces the Kennedy Space Center. The student independently took an additional internship at Boll Laboratories without informing his graduate advisor or the Department of Psychology. Because he was NOT making progress toward his degree, he elected not to pursue his graduate studies at Kansas State University and self-terminated from the program (spin without informing his advisor or the Department of Psychology]. What he accomplished for NASA in terms of usability testing at the Kennedy Space Center is unclear. NASA terminated support for the project: 07/30/99, including a $4,000 commitment to provide infrastructure support to the Department of Psychology.
Choi, Jeungok; Bakken, Suzanne
2010-01-01
Purpose Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. Methods To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users’ performance was measured by counting the time spent completing tasks and number of errors, as well as recording users’ perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Results Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants’ time to complete task varies from 81.2 seconds (SD=30.9) to 2.2 seconds (SD=1.3). Participants rated the Website as easy to use and useful (PEUU Mean= 4.52, SD=0.53). Based on the participants’ comments, appropriate modifications were made. Discussion and Conclusions Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was “simplicity” in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems. PMID:20617546
Xu, Lufei; Wen, Dong; Zhang, Xingting; Lei, Jianbo
2016-05-01
The objective of this study was to investigate the usability level of Chinese hospital Electronic Health Records (EHRs) by assessing the completion times of EHRs for seven "meaningful use (MU)" relevant tasks conducted at two Chinese tertiary hospitals and comparing the results to those of relevant research conducted in US EHRs. Using Rapid Usability Assessment (RUA) developed by the National Center for Cognitive Informatics and Decision Making (NCCD), the usability of EHRs from two Peking University hospitals was assessed using a three-step Keystroke Level Model (KLM) in a laboratory environment. (1) The total EHR task completion time for 7 MU relevant test tasks showed no significant differences between the two Chinese EHRs and their US counterparts, in which the time for thinking was relatively large and comprised 35.6% of the total time. The time for the electronic physician order was the largest. (2) For specific tasks, the mean completion times of the 2 hospital EHR systems spent on recording, modifying and searching (RMS) the medication orders were similar to those for the RMS radioactive tests; the mean time spent on the RMS laboratory test orders were much less. (3) There were 85 usability problems identified in the 2 hospital EHR systems. In Chinese EHRs, a substantial amount of time is required to complete tasks relevant to MU targets and many preventable usability problems can be discovered. The task completion time of the 2 Chinese EHR systems was a little shorter than in the 5 reported US EHR systems, while the differences in smoking status and CPOE tasks were obvious; one main reason for these differences was the use of structured data entry. The efficiency of Chinese and US EHRs was not significantly different. The key to improving the efficiency of both systems lies in expediting the Computerized physician order entry (CPOE) task. Many usability problems can be identified using heuristic assessments and improved by corresponding actions. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
Choi, Jeungok; Bakken, Suzanne
2010-08-01
Low health literacy has been associated with poor health-related outcomes. The purposes are to report the development of a website for low-literate parents in the Neonatal Intensive Care Unit (NICU), and the findings of heuristic evaluation and a usability testing of this website. To address low literacy of NICU parents, multimedia educational Website using visual aids (e.g., pictographs, photographs), voice-recorded text message in addition to a simplified text was developed. The text was created at the 5th grade readability level. The heuristic evaluation was conducted by three usability experts using 10 heuristics. End-users' performance was measured by counting the time spent completing tasks and number of errors, as well as recording users' perception of ease of use and usefulness (PEUU) in a sample of 10 NICU parents. Three evaluators identified 82 violations across the 10 heuristics. All violations, however, received scores <2, indicating minor usability problems. Participants' time to complete task varies from 81.2 s (SD = 30.9) to 2.2 s (SD = 1.3). Participants rated the Website as easy to use and useful (PEUU mean = 4.52, SD = 0.53). Based on the participants' comments, appropriate modifications were made. Different types of visuals on the Website were well accepted by low-literate users and agreement of visuals with text improved understanding of the educational materials over that with text alone. The findings suggest that using concrete and realistic pictures and pictographs with clear captions would maximize the benefit of visuals. One emerging theme was "simplicity" in design (e.g., limited use of colors, one font type and size), content (e.g., avoid lengthy text), and technical features (e.g., limited use of pop-ups). The heuristic evaluation by usability experts and the usability test with actual users provided complementary expertise, which can give a richer assessment of a design for low literacy Website. These results facilitated design modification and implementation of solutions by categorizing and prioritizing the usability problems.
Monitoring of changes in areas of conflicts: the example of Darfur
NASA Astrophysics Data System (ADS)
Thunig, H.; Michel, U.
2012-10-01
Rapid change detection is used in cases of natural hazards and disasters. This analysis leads to rapid information on areas of damage. In certain cases the lack of information after catastrophe events is obstructing supporting measures within disaster management. Earthquakes, tsunamis, civil war, volcanic eruption, droughts and floods have much in common: people are directly affected, landscapes and buildings are destroyed. In every case geospatial data is necessary to gain knowledge as basement for decision support. Where to go first? Which infrastructure is usable? How much area is affected? These are essential question which need to be answered before appropriate, eligible help can be established. This paper focuses on change detection applications in areas where catastrophic events took place which resulted in rapid destruction especially of manmade objects. Standard methods for automated change detection prove not to be sufficient; therefore a new method was developed and tested. The presented method allows a fast detection and visualization of change in areas of crisis or catastrophes. While often new methods of remote sensing are developed without user oriented aspects, organizations and authorities are not able to use these methods because of lack of remote sensing knowledge. Therefore a semi-automated procedure was developed. Within a transferable framework, the developed algorithm can be implemented for a set of remote sensing data among different investigation areas. Several case studies are the base for the retrieved results. Within a coarse dividing into statistical parts and the segmentation in meaningful objects, the framework is able to deal with different types of change. By means of an elaborated Temporal Change Index (TCI) only panchromatic datasets are used to extract areas which are destroyed, areas which were not affected and in addition areas where rebuilding has already started.
Schnall, Rebecca; Cho, Hwayoung; Liu, Jianfang
2018-01-05
Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. ©Rebecca Schnall, Hwayoung Cho, Jianfang Liu. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 05.01.2018.
Cho, Hwayoung; Liu, Jianfang
2018-01-01
Background Mobile technology has become a ubiquitous technology and can be particularly useful in the delivery of health interventions. This technology can allow us to deliver interventions to scale, cover broad geographic areas, and deliver technologies in highly tailored ways based on the preferences or characteristics of users. The broad use of mobile technologies supports the need for usability assessments of these tools. Although there have been a number of usability assessment instruments developed, none have been validated for use with mobile technologies. Objective The goal of this work was to validate the Health Information Technology Usability Evaluation Scale (Health-ITUES), a customizable usability assessment instrument in a sample of community-dwelling adults who were testing the use of a new mobile health (mHealth) technology. Methods A sample of 92 community-dwelling adults living with HIV used a new mobile app for symptom self-management and completed the Health-ITUES to assess the usability of the app. They also completed the Post-Study System Usability Questionnaire (PSSUQ), a widely used and well-validated usability assessment tool. Correlations between these scales and each of the subscales were assessed. Results The subscales of the Health-ITUES showed high internal consistency reliability (Cronbach alpha=.85-.92). Each of the Health-ITUES subscales and the overall scale was moderately to strongly correlated with the PSSUQ scales (r=.46-.70), demonstrating the criterion validity of the Health-ITUES. Conclusions The Health-ITUES has demonstrated reliability and validity for use in assessing the usability of mHealth technologies in community-dwelling adults living with a chronic illness. PMID:29305343
Held, Jeremia P; Ferrer, Begoña; Mainetti, Renato; Steblin, Alexander; Hertler, Benjamin; Moreno-Conde, Alberto; Dueñas, Alvaro; Pajaro, Marta; L-Parra-Calderón, Carlos; Vargiu, Eloisa; Zarco, Maria J; Barrera, Maria; Echevarria, Carmen; Jódar-Sánchez, Francisco; Luft, Andreas R; Borghese, Nunzio A
2017-09-25
New technologies, such as telerehabilitation and gaming devices offer the possibility for patients to train at home. This opens the challenge of safety for the patient as he is called to exercise neither with a therapist on the patients' side nor with a therapist linked remotely to supervise the sessions. To study the safety, usability and patient acceptance of an autonomous telerehabilitation system for balance and gait (the REWIRE platform) in the patients home. Cohort study. Community, in the stroke patients' home. 15 participants with first-ever stroke, with a mild to moderate residual deficit of the lower extremities. Autonomous rehabilitation based on virtual rehabilitation was provided at the participants' home for twelve weeks. The primary outcome was compliance (the ratio between days of actual and scheduled training), analysed with the two-tailed Wilcoxon Mann- Whitney test. Furthermore safety is defined by adverse events. The secondary endpoint was the acceptance of the system measured with the Technology Acceptance Model. Additionally, the cumulative duration of weekly training was analysed. During the study there were no adverse events related to the therapy. Patients performed on average 71% (range 39 to 92%) of the scheduled sessions. The Technology Acceptance Model Questionnaire showed excellent values for stroke patients after the training. The average training duration per week was 99 ±53min. Autonomous telerehabilitation for balance and gait training with the REWIRE-system is safe, feasible and can help to intensive rehabilitative therapy at home. Telerehabilitation enables safe training in home environment and supports of the standard rehabilitation therapy.
Schmutz, Sven; Sonderegger, Andreas; Sauer, Juergen
2017-09-01
The present study examined whether implementing recommendations of Web accessibility guidelines would have different effects on nondisabled users than on users with visual impairments. The predominant approach for making Web sites accessible for users with disabilities is to apply accessibility guidelines. However, it has been hardly examined whether this approach has side effects for nondisabled users. A comparison of the effects on both user groups would contribute to a better understanding of possible advantages and drawbacks of applying accessibility guidelines. Participants from two matched samples, comprising 55 participants with visual impairments and 55 without impairments, took part in a synchronous remote testing of a Web site. Each participant was randomly assigned to one of three Web sites, which differed in the level of accessibility (very low, low, and high) according to recommendations of the well-established Web Content Accessibility Guidelines 2.0 (WCAG 2.0). Performance (i.e., task completion rate and task completion time) and a range of subjective variables (i.e., perceived usability, positive affect, negative affect, perceived aesthetics, perceived workload, and user experience) were measured. Higher conformance to Web accessibility guidelines resulted in increased performance and more positive user ratings (e.g., perceived usability or aesthetics) for both user groups. There was no interaction between user group and accessibility level. Higher conformance to WCAG 2.0 may result in benefits for nondisabled users and users with visual impairments alike. Practitioners may use the present findings as a basis for deciding on whether and how to implement accessibility best.
A prototype mobile application for triaging dental emergencies.
Stein, Corey D; Xiao, Xiang; Levine, Steven; Schleyer, Titus K L; Hochheiser, Harry; Thyvalikakath, Thankam P
2016-10-01
Evidence suggests that dental emergencies are likely to occur when preferred care is less accessible. Communication barriers often exist that cause patients to receive suboptimal treatment or experience discomfort for extended lengths of time. Furthermore, limitations in the conventional approach for managing dental emergencies prevent dentists from receiving critical information before patient visits. The authors developed a mobile application to mediate the uncertainty of dental emergencies. The development and study consisted of a needs analysis and quality assessment of intraoral images captured by smartphones, prototype development, refining the prototype through usability inspection methods, and formative evaluation through usability testing with prospective users. The developed application successfully guided all users through a series of questions designed to capture clinically meaningful data by using familiar smartphone functions. All participants were able to complete a report within 4 minutes, and all clinical information was comprehended by the users. Patient-provided information accompanied by high-resolution images may help dentists substantially in predicting urgency or preparing necessary treatment resources. The results illustrate the feasibility of patients using smartphone applications to report dental emergencies. This technology allows dentists to assess care remotely when direct patient contact is less practical. This study's results demonstrate that patients can use mobile applications to transmit clinical data to their dentists and suggest the possibility of expanding the use of mobile applications to enhance access to routine and emergency dental care. The authors addressed how to enable patients to communicate emergency needs directly to a dentist while obviating patient emergency department visits. Copyright © 2016 American Dental Association. Published by Elsevier Inc. All rights reserved.
Usability of Optical Mark Reader Sheet as an Answering Tool in Testing.
Booka, Masayuki; Oku, Hidehisa; Scheller, Andreas; Yamaoka, Shintaro
2017-01-01
The research result on usability of Optical Mark Reader Sheet (OMRS) being used as the standard answering tool is reported. The use of OMRS significantly requires more answer time than the answer time without OMRS, and the use of assistive devices for OMRS has the possibility to reduce the answer time.
How and Why of User Studies: RLG's RedLightGreen as a Case Study
ERIC Educational Resources Information Center
Proffitt, Merrilee
2006-01-01
This article documents a lifecycle approach to employing user-centered design, covering both qualitative and quantitative data gathering methods in support of using this approach for product design, usability testing, and market research. The author provides specific case studies of usability studies, focus groups, interviews, ethnographic…
Earthdata Search Summer ESIP Usability Workshop
NASA Technical Reports Server (NTRS)
Reese, Mark; Sirato, Jeff
2017-01-01
The Earthdata Search Client has undergone multiple rounds of usability testing during 2017 and the user feedback received has resulted in an enhanced user interface. This session will showcase the new Earthdata Search Client user interface and provide hands-on experience for participants to learn how to search, visualize and download data in the desired format.
Johnson, Constance M; McIlwain, Steve; Gray, Oliver; Willson, Bradley; Vorderstrasse, Allison
2017-07-01
As the prevalence of chronic diseases increase, there is a need for consumer-centric health informatics applications that assist individuals with disease self-management skills. However, due to the cost of development of these applications, there is also a need to build a disease agnostic architecture so that they could be reused for any chronic disease. This paper describes the architecture of a collaborative virtual environment (VE) platform, LIVE©, that was developed to teach self-management skills and provide social support to those individuals with type 2 diabetes. However, a backend database allows for the application to be easily reused for any chronic disease. We tested its usability in the context of a larger randomized controlled trial of its efficacy. The usability was scored as 'good' by half of the participants in the evaluation. Common errors in the testing and solutions to address initial usability issues are discussed. Overall, LIVE© represents a usable and generalizable platform that will be adapted to other chronic diseases and health needs in future research and applications. Copyright © 2017 Elsevier Inc. All rights reserved.
Usability Testing of a Computerized Communication Tool in a Diverse Urban Pediatric Population
Tsimicalis, Argerie; Stone, Patricia W.; Bakken, Suzanne; Yoon, Sunmoo; Sands, Stephen; Porter, Rechelle; Ruland, Cornelia
2015-01-01
Background Developed in Norway, Sisom is an interactive, rigorously tested, computerized, communication tool designed to help children with cancer express their perceived symptoms/problems. Children travel virtually from island to island rating their symptoms/problems. While Sisom has been found to significantly improve communication in patient consultations in Norway, usability testing is warranted with US children prior to further use in research studies. Objective To determine the usability of Sisom in a sample of English and Spanish speaking children in an urban US community. Methods A mixed methods usability study was conducted with a purposive sample of healthy children and children with cancer. Semi-structured interviews were used to assess healthy children’s symptom recognition. Children with cancer completed 8 usability tasks captured with Morae® 3.3 software. Data were downloaded, transcribed, and analyzed descriptively. Results Four healthy children and 8 children with cancer participated. Of the 44 symptoms assessed, healthy children recognized 15 (34%) pictorial symptoms immediately or indicated 13 (30%) pictures were good representations of the symptom. Six children with cancer completed all tasks. All children navigated successfully from one island to the next, ranking their symptom/problem severity, clicking the magnifying glass for help, or asking the researcher for assistance. All children were satisfied with the aesthetics and expressed an interest in using Sisom to communicate their symptoms. Conclusions A few minor suggestions for improvement and adjustment may optimize the use of Sisom for US children. Implications for Practice Sisom may help clinicians overcome challenges assessing children’s complex symptoms/problems in a child-friendly manner. PMID:24457227
The STEP database through the end-users eyes--USABILITY STUDY.
Salunke, Smita; Tuleu, Catherine
2015-08-15
The user-designed database of Safety and Toxicity of Excipients for Paediatrics ("STEP") is created to address the shared need of drug development community to access the relevant information of excipients effortlessly. Usability testing was performed to validate if the database satisfies the need of the end-users. Evaluation framework was developed to assess the usability. The participants performed scenario based tasks and provided feedback and post-session usability ratings. Failure Mode Effect Analysis (FMEA) was performed to prioritize the problems and improvements to the STEP database design and functionalities. The study revealed several design vulnerabilities. Tasks such as limiting the results, running complex queries, location of data and registering to access the database were challenging. The three critical attributes identified to have impact on the usability of the STEP database included (1) content and presentation (2) the navigation and search features (3) potential end-users. Evaluation framework proved to be an effective method for evaluating database effectiveness and user satisfaction. This study provides strong initial support for the usability of the STEP database. Recommendations would be incorporated into the refinement of the database to improve its usability and increase user participation towards the advancement of the database. Copyright © 2015 Elsevier B.V. All rights reserved.
Birnie, Kathryn A; Kulandaivelu, Yalinie; Jibb, Lindsay; Hroch, Petra; Positano, Karyn; Robertson, Simon; Campbell, Fiona; Abla, Oussama; Stinson, Jennifer
2018-06-01
Needle procedures are among the most distressing aspects of pediatric cancer-related treatment. Virtual reality (VR) distraction offers promise for needle-related pain and distress given its highly immersive and interactive virtual environment. This study assessed the usability (ease of use and understanding, acceptability) of a custom VR intervention for children with cancer undergoing implantable venous access device (IVAD) needle insertion. Three iterative cycles of mixed-method usability testing with semistructured interviews were undertaken to refine the VR. Participants included 17 children and adolescents (8-18 years old) with cancer who used the VR intervention prior to or during IVAD access. Most participants reported the VR as easy to use (82%) and understand (94%), and would like to use it during subsequent needle procedures (94%). Based on usability testing, refinements were made to VR hardware, software, and clinical implementation. Refinements focused on increasing responsiveness, interaction, and immersion of the VR program, reducing head movement for VR interaction, and enabling participant alerts to steps of the procedure by clinical staff. No adverse events of nausea or dizziness were reported. The VR intervention was deemed acceptable and safe. Next steps include assessing feasibility and effectiveness of the VR intervention for pain and distress.
Gonser, Phillipp; Fuchsberger, Thomas; Matern, Ulrich
2017-08-01
The use of active medical devices in clinical routine should be as safe and efficient as possible. Usability tests (UTs) help improve these aspects of medical devices during their development, but UTs can be of use for hospitals even after a product has been launched. The present pilot study examines the costs and possible benefits of UT for hospitals before buying new medical devices for theatre. Two active medical devices with different complexity were tested in a standardized UT and a cost-benefit analysis was carried out assuming a different device bought at the same price with a higher usability could increase the efficiency of task solving and due to that save valuable theatre time. The cost of the UT amounted up to €19.400. Hospitals could benefit from UTs before buying new devices for theatre by reducing time-consuming operator errors and thereby increase productivity and patient safety. The possible benefits amounted from €23.300 to €1.570.000 (median = €797.000). Not only hospitals could benefit economically from investing in a UT before deciding to buy a medical device, but especially patients would profit from a higher usability by reducing possible operator errors and increase safety and performance of use.
Ambiguity of Quality in Remote Sensing Data
NASA Technical Reports Server (NTRS)
Lynnes, Christopher; Leptoukh, Greg
2010-01-01
This slide presentation reviews some of the issues in quality of remote sensing data. Data "quality" is used in several different contexts in remote sensing data, with quite different meanings. At the pixel level, quality typically refers to a quality control process exercised by the processing algorithm, not an explicit declaration of accuracy or precision. File level quality is usually a statistical summary of the pixel-level quality but is of doubtful use for scenes covering large areal extents. Quality at the dataset or product level, on the other hand, usually refers to how accurately the dataset is believed to represent the physical quantities it purports to measure. This assessment often bears but an indirect relationship at best to pixel level quality. In addition to ambiguity at different levels of granularity, ambiguity is endemic within levels. Pixel-level quality terms vary widely, as do recommendations for use of these flags. At the dataset/product level, quality for low-resolution gridded products is often extrapolated from validation campaigns using high spatial resolution swath data, a suspect practice at best. Making use of quality at all levels is complicated by the dependence on application needs. We will present examples of the various meanings of quality in remote sensing data and possible ways forward toward a more unified and usable quality framework.
Science Data Preservation: Implementation and Why It Is Important
NASA Technical Reports Server (NTRS)
Kempler, Steven J.; Moses, John F.; Gerasimov, Irina V.; Johnson, James E.; Vollmer, Bruce E.; Theobald, Michael L.; Ostrenga, Dana M.; Ahmad, Suraiya; Ramapriyan, Hampapuram K.; Khayat, Mohammad G.
2013-01-01
Remote Sensing data generation by NASA to study Earth s geophysical processes was initiated in 1960 with the launch of the first Television Infrared Observation Satellite Program (TIROS), to develop a meteorological satellite information system. What would be deemed as a primitive data set by today s standards, early Earth science missions were the foundation upon which today s remote sensing instruments have built their scientific success, and tomorrow s instruments will yield science not yet imagined. NASA Scientific Data Stewardship requirements have been documented to ensure the long term preservation and usability of remote sensing science data. In recent years, the Federation of Earth Science Information Partners and NASA s Earth Science Data System Working Groups have organized committees that specifically examine standards, processes, and ontologies that can best be employed for the preservation of remote sensing data, supporting documentation, and data provenance information. This presentation describes the activities, issues, and implementations, guided by the NASA Earth Science Data Preservation Content Specification (423-SPEC-001), for preserving instrument characteristics, and data processing and science information generated for 20 Earth science instruments, spanning 40 years of geophysical measurements, at the NASA s Goddard Earth Sciences Data and Information Services Center (GES DISC). In addition, unanticipated preservation/implementation questions and issues in the implementation process are presented.
Serving Satellite Remote Sensing Data to User Community through the OGC Interoperability Protocols
NASA Astrophysics Data System (ADS)
di, L.; Yang, W.; Bai, Y.
2005-12-01
Remote sensing is one of the major methods for collecting geospatial data. Hugh amount of remote sensing data has been collected by space agencies and private companies around the world. For example, NASA's Earth Observing System (EOS) is generating more than 3 Tb of remote sensing data per day. The data collected by EOS are processed, distributed, archived, and managed by the EOS Data and Information System (EOSDIS). Currently, EOSDIS is managing several petabytes of data. All of those data are not only valuable for global change research, but also useful for local and regional application and decision makings. How to make the data easily accessible to and usable by the user community is one of key issues for realizing the full potential of these valuable datasets. In the past several years, the Open Geospatial Consortium (OGC) has developed several interoperability protocols aiming at making geospatial data easily accessible to and usable by the user community through Internet. The protocols particularly relevant to the discovery, access, and integration of multi-source satellite remote sensing data are the Catalog Service for Web (CS/W) and Web Coverage Services (WCS) Specifications. The OGC CS/W specifies the interfaces, HTTP protocol bindings, and a framework for defining application profiles required to publish and access digital catalogues of metadata for geographic data, services, and related resource information. The OGC WCS specification defines the interfaces between web-based clients and servers for accessing on-line multi-dimensional, multi-temporal geospatial coverage in an interoperable way. Based on definitions by OGC and ISO 19123, coverage data include all remote sensing images as well as gridded model outputs. The Laboratory for Advanced Information Technology and Standards (LAITS), George Mason University, has been working on developing and implementing OGC specifications for better serving NASA Earth science data to the user community for many years. We have developed the NWGISS software package that implements multiple OGC specifications, including OGC WMS, WCS, CS/W, and WFS. As a part of NASA REASON GeoBrain project, the NWGISS WCS and CS/W servers have been extended to provide operational access to NASA EOS data at data pools through OGC protocols and to make both services chainable in the web-service chaining. The extensions in the WCS server include the implementation of WCS 1.0.0 and WCS 1.0.2, and the development of WSDL description of the WCS services. In order to find the on-line EOS data resources, the CS/W server is extended at the backend to search metadata in NASA ECHO. This presentation reports those extensions and discuss lessons-learned on the implementation. It also discusses the advantage, disadvantages, and future improvement of OGC specifications, particularly the WCS.
Adapting an in-person patient-caregiver communication intervention to a tailored web-based format.
Zulman, Donna M; Schafenacker, Ann; Barr, Kathryn L C; Moore, Ian T; Fisher, Jake; McCurdy, Kathryn; Derry, Holly A; Saunders, Edward W; An, Lawrence C; Northouse, Laurel
2012-03-01
Interventions that target cancer patients and their caregivers have been shown to improve patient-caregiver communication, support, and emotional well-being. To adapt an in-person communication intervention for cancer patients and caregivers to a web-based format, and to examine the usability and acceptability of the web-based program among representative users. A tailored, interactive web-based communication program for cancer patients and their family caregivers was developed based on an existing in-person, nurse-delivered intervention. The development process involved: (1) building a multidisciplinary team of content and web design experts, (2) combining key components of the in-person intervention with the unique tailoring and interactive features of a web-based platform, and (3) conducting focus groups and usability testing to obtain feedback from representative program users at multiple time points. Four focus groups with 2-3 patient-caregiver pairs per group (n = 22 total participants) and two iterations of usability testing with four patient-caregiver pairs per session (n = 16 total participants) were conducted. Response to the program's structure, design, and content was favorable, even among users who were older or had limited computer and Internet experience. The program received high ratings for ease of use and overall usability (mean System Usability Score of 89.5 out of 100). Many elements of a nurse-delivered patient-caregiver intervention can be successfully adapted to a web-based format. A multidisciplinary design team and an iterative evaluation process with representative users were instrumental in the development of a usable and well-received web-based program. Copyright © 2011 John Wiley & Sons, Ltd.
Zulman, Donna M.; Schafenacker, Ann; Barr, Kathryn L.C.; Moore, Ian T.; Fisher, Jake; McCurdy, Kathryn; Derry, Holly A.; Saunders, Edward W.; An, Lawrence C.; Northouse, Laurel
2011-01-01
Background Interventions that target cancer patients and their caregivers have been shown to improve communication, support, and emotional well-being. Objective To adapt an in-person communication intervention for cancer patients and caregivers to a web-based format, and to examine the usability and acceptability of the web-based program among representative users. Methods A tailored, interactive web-based communication program for cancer patients and their family caregivers was developed based on an existing in-person, nurse-delivered intervention. The development process involved: 1) building a multidisciplinary team of content and web design experts, 2) combining key components of the in-person intervention with the unique tailoring and interactive features of a web-based platform, and 3) conducting focus groups and usability testing to obtain feedback from representative program users at multiple time points. Results Four focus groups with 2 to 3 patient-caregiver pairs per group (n = 22 total participants) and two iterations of usability testing with 4 patient-caregiver pairs per session (n = 16 total participants) were conducted. Response to the program's structure, design, and content was favorable, even among users who were older or had limited computer and internet experience. The program received high ratings for ease of use and overall usability (mean System Usability Score of 89.5 out of 100). Conclusions Many elements of a nurse-delivered patient-caregiver intervention can be successfully adapted to a web-based format. A multidisciplinary design team and an iterative evaluation process with representative users were instrumental in the development of a usable and well-received web-based program. PMID:21830255
Comparing usability testing outcomes and functions of six electronic nursing record systems.
Cho, Insook; Kim, Eunman; Choi, Woan Heui; Staggers, Nancy
2016-04-01
This study examined the usability of six differing electronic nursing record (ENR) systems on the efficiency, proficiency and available functions for documenting nursing care and subsequently compared the results to nurses' perceived satisfaction from a previous study. The six hospitals had different ENR systems, all with narrative nursing notes in use for more than three years. Stratified by type of nursing unit, 54 staff nurses were digitally recorded during on-site usability testing by employing validated patient care scenarios and think-aloud protocols. The time to complete specific tasks was also measured. Qualitative performance data were converted into scores on efficiency (relevancy), proficiency (accuracy), and a competency index using scoring schemes described by McGuire and Babbott. Six nurse managers and the researchers completed assessments of available ENR functions and examined computerized nursing process components including the linkages among them. For the usability test, participants' mean efficiency score was 94.2% (95% CI, 91.4-96.9%). The mean proficiency was 60.6% (95% CI, 54.3-66.8%), and the mean competency index was 59.5% (95% CI, 52.9-66.0). Efficiency scores were significantly different across ENRs as was the time to complete tasks, ranging from 226.3 to 457.2s (χ(2)=12.3, P=0.031; χ(2)=11.2, P=0.048). No significant differences were seen for proficiency scores. The coverage of the various ENRs' nursing process ranged from 67% to 100%, but only two systems had complete integration of nursing components. Two systems with high efficiency and proficiency scores had much lower usability test scores and perceived user satisfaction along with more complex navigation patterns. In terms of system usability and functions, different levels of sophistication of and interaction performance with ENR systems exist in practice. This suggests that ENRs may have variable impacts on clinical outcomes and care quality. Future studies are needed to explore ENR impact on nursing care quality, efficiency, and safety. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
A Serious Game for Teaching Nursing Students Clinical Reasoning and Decision-Making Skills.
Johnsen, Hege Mari; Fossum, Mariann; Vivekananda-Schmidt, Pirashanthie; Fruhling, Ann; Slettebø, Åshild
2016-01-01
The aim of this study was to design and pilot-test a serious game for teaching nursing students clinical reasoning and decision-making skills in caring for patients with chronic obstructive pulmonary disease. A video-based serious game prototype was developed. A purposeful sample of six participants tested and evaluated the prototype. Usability issues were identified regarding functionality and user-computer interface. However, overall the serious game was perceived to be useful, usable and likable to use.
NASA Technical Reports Server (NTRS)
Zuzek, J. E.; Bhasin, K. B.
1996-01-01
Health care services delivered from a distance, known collectively as telemedicine, are being increasingly demonstrated on various transmission media. Telemedicine activities have included diagnosis by a doctor at a remote location, emergency and disaster medical assistance, medical education, and medical informatics. The ability of communications satellites to offer communication channels and bandwidth on demand, connectivity to mobile, remote and under served regions, and global access will afford them a critical role for telemedicine applications within the National and Global Information Infrastructure (NII/GII). The importance that communications satellites will have in telemedicine applications within the NII/GII the differences in requirements for NII vs. GII, the major issues such as interoperability, confidentiality, quality, availability, and costs, and preliminary conclusions for future usability based on the review of several recent trails at national and global levels are presented.
A neural-based remote eye gaze tracker under natural head motion.
Torricelli, Diego; Conforto, Silvia; Schmid, Maurizio; D'Alessio, Tommaso
2008-10-01
A novel approach to view-based eye gaze tracking for human computer interface (HCI) is presented. The proposed method combines different techniques to address the problems of head motion, illumination and usability in the framework of low cost applications. Feature detection and tracking algorithms have been designed to obtain an automatic setup and strengthen the robustness to light conditions. An extensive analysis of neural solutions has been performed to deal with the non-linearity associated with gaze mapping under free-head conditions. No specific hardware, such as infrared illumination or high-resolution cameras, is needed, rather a simple commercial webcam working in visible light spectrum suffices. The system is able to classify the gaze direction of the user over a 15-zone graphical interface, with a success rate of 95% and a global accuracy of around 2 degrees , comparable with the vast majority of existing remote gaze trackers.
Health figures: an open source JavaScript library for health data visualization.
Ledesma, Andres; Al-Musawi, Mohammed; Nieminen, Hannu
2016-03-22
The way we look at data has a great impact on how we can understand it, particularly when the data is related to health and wellness. Due to the increased use of self-tracking devices and the ongoing shift towards preventive medicine, better understanding of our health data is an important part of improving the general welfare of the citizens. Electronic Health Records, self-tracking devices and mobile applications provide a rich variety of data but it often becomes difficult to understand. We implemented the hFigures library inspired on the hGraph visualization with additional improvements. The purpose of the library is to provide a visual representation of the evolution of health measurements in a complete and useful manner. We researched the usefulness and usability of the library by building an application for health data visualization in a health coaching program. We performed a user evaluation with Heuristic Evaluation, Controlled User Testing and Usability Questionnaires. In the Heuristics Evaluation the average response was 6.3 out of 7 points and the Cognitive Walkthrough done by usability experts indicated no design or mismatch errors. In the CSUQ usability test the system obtained an average score of 6.13 out of 7, and in the ASQ usability test the overall satisfaction score was 6.64 out of 7. We developed hFigures, an open source library for visualizing a complete, accurate and normalized graphical representation of health data. The idea is based on the concept of the hGraph but it provides additional key features, including a comparison of multiple health measurements over time. We conducted a usability evaluation of the library as a key component of an application for health and wellness monitoring. The results indicate that the data visualization library was helpful in assisting users in understanding health data and its evolution over time.
Vermeulen, Joan; Neyens, Jacques CL; Spreeuwenberg, Marieke D; van Rossum, Erik; Sipers, Walther; Habets, Herbert; Hewson, David J; de Witte, Luc P
2013-01-01
Purpose To involve elderly people during the development of a mobile interface of a monitoring system that provides feedback to them regarding changes in physical functioning and to test the system in a pilot study. Methods and participants The iterative user-centered development process consisted of the following phases: (1) selection of user representatives; (2) analysis of users and their context; (3) identification of user requirements; (4) development of the interface; and (5) evaluation of the interface in the lab. Subsequently, the monitoring and feedback system was tested in a pilot study by five patients who were recruited via a geriatric outpatient clinic. Participants used a bathroom scale to monitor weight and balance, and a mobile phone to monitor physical activity on a daily basis for six weeks. Personalized feedback was provided via the interface of the mobile phone. Usability was evaluated on a scale from 1 to 7 using a modified version of the Post-Study System Usability Questionnaire (PSSUQ); higher scores indicated better usability. Interviews were conducted to gain insight into the experiences of the participants with the system. Results The developed interface uses colors, emoticons, and written and/or spoken text messages to provide daily feedback regarding (changes in) weight, balance, and physical activity. The participants rated the usability of the monitoring and feedback system with a mean score of 5.2 (standard deviation 0.90) on the modified PSSUQ. The interviews revealed that most participants liked using the system and appreciated that it signaled changes in their physical functioning. However, usability was negatively influenced by a few technical errors. Conclusion Involvement of elderly users during the development process resulted in an interface with good usability. However, the technical functioning of the monitoring system needs to be optimized before it can be used to support elderly people in their self-management. PMID:24039407
Usability evaluation of mobile applications; where do we stand?
NASA Astrophysics Data System (ADS)
Zahra, Fatima; Hussain, Azham; Mohd, Haslina
2017-10-01
The range and availability of mobile applications is expanding rapidly. With the increased processing power available on portable devices, developers are increasing the range of services by embracing smartphones in their extensive and diverse practices. While usability testing and evaluations of mobile applications have not yet touched the accuracy level of other web based applications. The existing usability models do not adequately capture the complexities of interacting with applications on a mobile platform. Therefore, this study aims to presents review on existing usability models for mobile applications. These models are in their infancy but with time and more research they may eventually be adopted. Moreover, different categories of mobile apps (medical, entertainment, education) possess different functional and non-functional requirements thus customized models are required for diverse mobile applications.
Advanced Weather Awareness and Reporting Enhancements
NASA Technical Reports Server (NTRS)
Busquets, Anthony M. (Technical Monitor); Ruokangas, Corinne Clinton; Kelly, Wallace E., III
2005-01-01
AWARE (Aviation Weather Awareness and Reporting Enhancements) was a NASA Cooperative Research and Development program conducted jointly by Rockwell Scientific, Rockwell Collins, and NASA. The effort culminated in an enhanced weather briefing and reporting tool prototype designed to integrate graphical and text-based aviation weather data to provide clear situational awareness in the context of a specific pilot, flight and equipment profile. The initial implementation of AWARE was as a web-based preflight planning tool, specifically for general aviation pilots, who do not have access to support such as the dispatchers available for commercial airlines. Initial usability tests showed that for VFR (Visual Flight Rules) pilots, AWARE provided faster and more effective weather evaluation. In a subsequent formal usability test for IFR (Instrument Flight Rules) pilots, all users finished the AWARE tests faster than the parallel DUAT tests, and all subjects graded AWARE higher for effectiveness, efficiency, and usability. The decision analysis basis of AWARE differentiates it from other aviation safety programs, providing analysis of context-sensitive data in a personalized graphical format to aid pilots/dispatchers in their complex flight requirements.
NASA Johnson Space Center Usability Testing and Analysis Facility (UTAF) Overview
NASA Technical Reports Server (NTRS)
Whitmore, M.
2004-01-01
The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility provides support to the Office of Biological and Physical Research, the Space Shuttle Program, the International Space Station Program, and other NASA organizations. In addition, there are ongoing collaborative research efforts with external businesses and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes. This presentation will provide an overview of ongoing activities, and will address how the projects will evolve to meet new space initiatives.
NASA Johnson Space Center Usability Testing and Analysis Facility (WAF) Overview
NASA Technical Reports Server (NTRS)
Whitmore, M.
2004-01-01
The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility provides support to the Office of Biological and Physical Research, the Space Shuttle Program, the International Space Station Program, and other NASA organizations. In addition, there are ongoing collaborative research efforts with external businesses and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes. This presentation will provide an overview of ongoing activities, and will address how the projects will evolve to meet new space initiatives.
NASA Astrophysics Data System (ADS)
Siarto, J.
2014-12-01
As more Earth science software tools and services move to the web--the design and usability of those tools become ever more important. A good user interface is becoming expected and users are becoming increasingly intolerant of websites and web applications that work against them. The Earthdata UI Pattern Library attempts to give these scientists and developers the design tools they need to make usable, compelling user interfaces without the associated overhead of using a full design team. Patterns are tested and functional user interface elements targeted specifically at the Earth science community and will include web layouts, buttons, tables, typography, iconography, mapping and visualization/graphing widgets. These UI elements have emerged as the result of extensive user testing, research and software development within the NASA Earthdata team over the past year.
Evaluating the Usability of a Professional Modeling Tool Repurposed for Middle School Learning
ERIC Educational Resources Information Center
Peters, Vanessa L.; Songer, Nancy Butler
2013-01-01
This paper reports the results of a three-stage usability test of a modeling tool designed to support learners' deep understanding of the impacts of climate change on ecosystems. The design process involved repurposing an existing modeling technology used by professional scientists into a learning tool specifically designed for middle school…
Digital Resource Exchange About Music (DREAM): Phase 2 Usability Testing
ERIC Educational Resources Information Center
Upitis, Rena; Boese, Karen; Abrami, Philip C.; Anwar, Zaeem
2015-01-01
The Digital Resource Exchange About Music (DREAM) is a virtual space for exchanging information about digital learning tools. The purpose of the present study was to determine how users responded to DREAM in the first four months after its public release. This study is the second phase of usability research on DREAM, and was conducted to guide…
ERIC Educational Resources Information Center
Hamel, Marie-Josee; Caws, Catherine
2010-01-01
This article discusses CALL development from both educational and ergonomic perspectives. It focuses on the learner-task-tool interaction, in particular on the aspects contributing to its overall quality, herein called "usability." Two pilot studies are described that were carried out with intermediate to advanced learners of French in two…
User-Centered Innovation: A Model for "Early Usability Testing."
ERIC Educational Resources Information Center
Sugar, William A.; Boling, Elizabeth
The goal of this study is to show how some concepts and techniques from disciplines outside Instructional Systems Development (ISD) have the potential to extend and enhance the traditional view of ISD practice when they are employed very early in the ISD process. The concepts and techniques employed were user-centered in design and usability, and…
ERIC Educational Resources Information Center
Gould, Christine E.; Zapata, Aimee Marie L.; Shinsky, Deanna N.; Goldstein, Mary K.
2018-01-01
DVD-delivered behavioral skills training may help disseminate efficacious treatments to older adults independent of internet access. The present study examined the usability of a portable DVD player alongside iterative revisions of accompanying instructions to be used by older adults in a DVD-delivered behavioral skills treatment study. The sample…
ERIC Educational Resources Information Center
Simunich, Bethany; Robins, David B.; Kelly, Valerie
2015-01-01
This study investigated whether "findability," an aspect of usability, is an important component in student perceptions of/satisfaction with online courses and, as such, should be considered more heavily in online course design. Using standard usability testing measures, such as eye-tracking, time-on-task, and think-alouds, participants…
An appraisal of published usability evaluations of electronic health records via systematic review.
Ellsworth, Marc A; Dziadzko, Mikhail; O'Horo, John C; Farrell, Ann M; Zhang, Jiajie; Herasevich, Vitaly
2017-01-01
In this systematic review, we aimed to evaluate methodological and reporting trends present in the current literature by investigating published usability studies of electronic health records (EHRs). A literature search was conducted for articles published through January 2015 using MEDLINE (Ovid), EMBASE, Scopus, and Web of Science, supplemented by citation and reference list reviews. Studies were included if they tested the usability of hospital and clinic EHR systems in the inpatient, outpatient, emergency department, or operating room setting. A total of 4848 references were identified for title and abstract screening. Full text screening was performed for 197 articles, with 120 meeting the criteria for study inclusion. A review of the literature demonstrates a paucity of quality published studies describing scientifically valid and reproducible usability evaluations at various stages of EHR system development. A lack of formal and standardized reporting of EHR usability evaluation results is a major contributor to this knowledge gap, and efforts to improve this deficiency will be one step of moving the field of usability engineering forward. © The Author 2016. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com.
Harnessing Scientific Literature Reports for Pharmacovigilance
Ripple, Anna; Tonning, Joseph; Munoz, Monica; Hasan, Rashedul; Ly, Thomas; Francis, Henry; Bodenreider, Olivier
2017-01-01
Summary Objectives We seek to develop a prototype software analytical tool to augment FDA regulatory reviewers’ capacity to harness scientific literature reports in PubMed/MEDLINE for pharmacovigilance and adverse drug event (ADE) safety signal detection. We also aim to gather feedback through usability testing to assess design, performance, and user satisfaction with the tool. Methods A prototype, open source, web-based, software analytical tool generated statistical disproportionality data mining signal scores and dynamic visual analytics for ADE safety signal detection and management. We leveraged Medical Subject Heading (MeSH) indexing terms assigned to published citations in PubMed/MEDLINE to generate candidate drug-adverse event pairs for quantitative data mining. Six FDA regulatory reviewers participated in usability testing by employing the tool as part of their ongoing real-life pharmacovigilance activities to provide subjective feedback on its practical impact, added value, and fitness for use. Results All usability test participants cited the tool’s ease of learning, ease of use, and generation of quantitative ADE safety signals, some of which corresponded to known established adverse drug reactions. Potential concerns included the comparability of the tool’s automated literature search relative to a manual ‘all fields’ PubMed search, missing drugs and adverse event terms, interpretation of signal scores, and integration with existing computer-based analytical tools. Conclusions Usability testing demonstrated that this novel tool can automate the detection of ADE safety signals from published literature reports. Various mitigation strategies are described to foster improvements in design, productivity, and end user satisfaction. PMID:28326432
Comparison of Brief Summary Formats Through a Health Literacy Lens.
Sharp, Michele L; Hall, Lori; Eleftherion, Anthony; Simpson, Katherine; Neuhauser, Linda
2018-01-01
Print pharmaceutical advertisements in the United States require inclusion of a brief summary of side effects, warnings, precautions, and contraindications from the labeling. The full package insert, which sponsors have traditionally used to fulfill the brief summary requirement, does not adhere to health literacy best practices, limiting its value to consumers. This study compared the understandability and usability of brief summaries in 3 formats designed to be more consumer friendly. Three brief summary formats were tested: (1) 2-column "Question and Answer"; (2) "Prescription Drug Facts Box," similar to current US over-the-counter drug facts labeling; and (3) "Health Literacy," based on clear communication principles. Researchers evaluated the formats using the Suitability Assessment of Materials (SAM) tool and conducted structured, scripted, one-on-one interviews (usability tests) with participants with estimated low to average education levels. This research was replicated across 2 therapeutic areas (type 2 diabetes and plaque psoriasis). SAM scores showed that the Health Literacy format outperformed the Question and Answer format and the Prescription Drug Facts Box format in both therapeutic areas, with both Health Literacy brief summaries rated on the SAM as "superior." Qualitative usability tests supported the SAM findings, with the Health Literacy format preferred consistently over the Question and Answer format, and more often than not over the Prescription Drug Facts Box format. Sponsors can employ a user-tested Health Literacy format to improve the understandability and usability of brief summaries with patients.
Cercenelli, Laura; Tiberi, Guido; Corazza, Ivan; Giannaccare, Giuseppe; Fresina, Michela; Marcelli, Emanuela
2017-01-01
Many open source software packages have been recently developed to expand the usability of eye tracking systems to study oculomotor behavior, but none of these is specifically designed to encompass all the main functions required for creating eye tracking tests and for providing the automatic analysis of saccadic eye movements. The aim of this study is to introduce SacLab, an intuitive, freely-available MATLAB toolbox based on Graphical User Interfaces (GUIs) that we have developed to increase the usability of the ViewPoint EyeTracker (Arrington Research, Scottsdale, AZ, USA) in clinical ophthalmology practice. SacLab consists of four processing modules that enable the user to easily create visual stimuli tests (Test Designer), record saccadic eye movements (Data Recorder), analyze the recorded data to automatically extract saccadic parameters of clinical interest (Data Analyzer) and provide an aggregate analysis from multiple eye movements recordings (Saccade Analyzer), without requiring any programming effort by the user. A demo application of SacLab to carry out eye tracking tests for the analysis of horizontal saccades was reported. We tested the usability of SacLab toolbox with three ophthalmologists who had no programming experience; the ophthalmologists were briefly trained in the use of SacLab GUIs and were asked to perform the demo application. The toolbox gained an enthusiastic feedback from all the clinicians in terms of intuitiveness, ease of use and flexibility. Test creation and data processing were accomplished in 52±21s and 46±19s, respectively, using the SacLab GUIs. SacLab may represent a useful tool to ease the application of the ViewPoint EyeTracker system in clinical routine in ophthalmology. Copyright © 2016 Elsevier Ltd. All rights reserved.
Usability evaluation of the SMART application for youth with mTBI.
Dexheimer, Judith W; Kurowski, Brad G; Anders, Shilo H; McClanahan, Nicole; Wade, Shari L; Babcock, Lynn
2017-01-01
There is a dearth of evidence-based treatments available to address the significant morbidity associated with mild traumatic brain injury (mTBI). To address this gap, we designed a novel user-friendly, web-based application. We describe the preliminary evaluation of feasibility and usability of the application to promote recovery following mTBI in youth, the Self-Monitoring Activity-Restriction and Relaxation Treatment (SMART). SMART incorporates real-time recommendations for individualized symptom management and activity restriction along with training in cognitive-behavioral coping strategies. We conducted a usability evaluation to assess and modify the SMART system prior to further study and deployment. Children ages 11-18 years presenting to the emergency department were recruited after symptoms resolved. Usability was assessed using a 60-min think-aloud protocol of teens and parents describing their interaction with the application. Upon completion of the tasks, each participant also completed the system usability scale (SUS). We performed tests with 4 parent/child dyads. The average age of the children was 13 years (standard deviation=1.8). The parents were an average of 41.5 years old (standard deviation=6.2). Research revealed that the participants were enthusiastic about the interactive portions of the tool particularly the video based sessions. Parents were concerned about the speed at which their child might move through the program and the children thought that the system required large amounts of reading. Based on user feedback, researchers modified SMART to include an audio file in every module and improved the system's aesthetic properties. The mean SUS score was 85, with high SUS scores (>68) indicating satisfactory usability. High initial usability and favorable user feedback provide a foundation for further iterative development and testing of the SMART application as a tool for managing recovery from concussion. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
Hetts, S.W.; Saeed, M.; Martin, A.J.; Evans, L.; Bernhardt, A.F.; Malba, V.; Settecase, F.; Do, L.; Yee, E.J.; Losey, A.; Sincic, R.; Roy, S.; Arenson, R.L.; Wilson, M.W.
2013-01-01
BACKGROUND AND PURPOSE: Endovascular navigation under MR imaging guidance can be facilitated by a catheter with steerable microcoils on the tip. Not only do microcoils create visible artifacts allowing catheter tracking, but also they create a small magnetic moment permitting remote-controlled catheter tip deflection. A side product of catheter tip electrical currents, however, is the heat that might damage blood vessels. We sought to determine the upper boundary of electrical currents safely usable at 1.5T in a coil-tipped microcatheter system. MATERIALS AND METHODS: Alumina tubes with solenoid copper coils were attached to neurovascular microcatheters with heat shrink-wrap. Catheters were tested in carotid arteries of 8 pigs. The catheters were advanced under x-ray fluoroscopy and MR imaging. Currents from 0 mA to 700 mA were applied to test heating and potential vascular damage. Postmortem histologic analysis was the primary endpoint. RESULTS: Several heat-mitigation strategies demonstrated negligible vascular damage compared with control arteries. Coil currents ≤300 mA resulted in no damage (0/58 samples) compared with 9 (25%) of 36 samples for > 300-mA activations (P = .0001). Tip coil activation ≤1 minute and a proximal carotid guide catheter saline drip > 2 mL/minute also had a nonsignificantly lower likelihood of vascular damage. For catheter tip coil activations ≤300 mA for ≤1 minute in normal carotid flow, 0 of 43 samples had tissue damage. CONCLUSIONS: Activations of copper coils at the tip of microcatheters at low currents in 1.5T MR scanners can be achieved without significant damage to blood vessel walls in a controlled experimental setting. Further optimization of catheter design and procedure protocols is necessary for safe remote control magnetic catheter guidance. PMID:23846795
A pilot study of distributed knowledge management and clinical decision support in the cloud.
Dixon, Brian E; Simonaitis, Linas; Goldberg, Howard S; Paterno, Marilyn D; Schaeffer, Molly; Hongsermeier, Tonya; Wright, Adam; Middleton, Blackford
2013-09-01
Implement and perform pilot testing of web-based clinical decision support services using a novel framework for creating and managing clinical knowledge in a distributed fashion using the cloud. The pilot sought to (1) develop and test connectivity to an external clinical decision support (CDS) service, (2) assess the exchange of data to and knowledge from the external CDS service, and (3) capture lessons to guide expansion to more practice sites and users. The Clinical Decision Support Consortium created a repository of shared CDS knowledge for managing hypertension, diabetes, and coronary artery disease in a community cloud hosted by Partners HealthCare. A limited data set for primary care patients at a separate health system was securely transmitted to a CDS rules engine hosted in the cloud. Preventive care reminders triggered by the limited data set were returned for display to clinician end users for review and display. During a pilot study, we (1) monitored connectivity and system performance, (2) studied the exchange of data and decision support reminders between the two health systems, and (3) captured lessons. During the six month pilot study, there were 1339 patient encounters in which information was successfully exchanged. Preventive care reminders were displayed during 57% of patient visits, most often reminding physicians to monitor blood pressure for hypertensive patients (29%) and order eye exams for patients with diabetes (28%). Lessons learned were grouped into five themes: performance, governance, semantic interoperability, ongoing adjustments, and usability. Remote, asynchronous cloud-based decision support performed reasonably well, although issues concerning governance, semantic interoperability, and usability remain key challenges for successful adoption and use of cloud-based CDS that will require collaboration between biomedical informatics and computer science disciplines. Decision support in the cloud is feasible and may be a reasonable path toward achieving better support of clinical decision-making across the widest range of health care providers. Published by Elsevier B.V.
Rimmer, James H; Johnson, George; Wilroy, Jereme; Young, Hui-Ju; Mehta, Tapan; Lai, Byron
2018-01-01
Background People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations). Objective This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation. Methods Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach. Results During testing of the app’s effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready to be delivered to the public after minor revisions. After including these revisions, the project team released the final app that is being used in the randomized controlled trial. Conclusions A multi-level user-centered development process resulted in the development of an inclusive exercise program for people with multiple sclerosis operated through an easy-to-use app. The promotion of exercise through self-regulated mHealth programs requires a stakeholder-driven approach to app development. This ensures that app and content match the preferences and functional abilities of the end user (ie, people with varying levels of multiple sclerosis). PMID:29798832
Thirumalai, Mohanraj; Rimmer, James H; Johnson, George; Wilroy, Jereme; Young, Hui-Ju; Mehta, Tapan; Lai, Byron
2018-05-24
People with multiple sclerosis face varying levels of disability and symptoms, thus requiring highly trained therapists and/or exercise trainers to design personalized exercise programs. However, for people living in geographically isolated communities, access to such trained professionals can be challenging due to a number of barriers associated with cost, access to transportation, and travel distance. Generic mobile health exercise apps often fall short of what people with multiple sclerosis need to become physically active (ie, exercise content that has been adapted to accommodate a wide range of functional limitations). This usability study describes the development process of the TEAMS (Tele-Exercise and Multiple Sclerosis) app, which is being used by people with multiple sclerosis in a large randomized controlled trial to engage in home-based telerehabilitation. Twenty-one participants with disabilities (10 people with multiple sclerosis) were involved in the double iterative design, which included the simultaneous development of the app features and exercise content (exercise videos and articles). Framed within a user-centered design approach, the development process included 2 stages: ground-level creation (focus group followed by early stage evaluations and developments), and proof of concept through 2 usability tests. Usability (effectiveness, usefulness, and satisfaction) was evaluated using a mixed-methods approach. During testing of the app's effectiveness, the second usability test resulted in an average of 1 problem per participant, a decrease of 53% compared to the initial usability test. Five themes were constructed from the qualitative data that related to app usefulness and satisfaction, namely: high perceived confidence for app usability, positive perceptions of exercise videos, viable exercise option at home, orientation and familiarity required for successful participation, and app issues. Participants acknowledged that the final app was ready to be delivered to the public after minor revisions. After including these revisions, the project team released the final app that is being used in the randomized controlled trial. A multi-level user-centered development process resulted in the development of an inclusive exercise program for people with multiple sclerosis operated through an easy-to-use app. The promotion of exercise through self-regulated mHealth programs requires a stakeholder-driven approach to app development. This ensures that app and content match the preferences and functional abilities of the end user (ie, people with varying levels of multiple sclerosis). ©Mohanraj Thirumalai, James H Rimmer, George Johnson, Jereme Wilroy, Hui-Ju Young, Tapan Mehta, Byron Lai. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 24.05.2018.
Measurement of Usability for Multimedia Interactive Learning Based on Website in Mathematics for SMK
NASA Astrophysics Data System (ADS)
Sukardjo, Moch.; Sugiyanta, Lipur
2018-04-01
Web usability, if evaluation done correctly, can significantly improve the quality of the website. Website containing multimedia for education shoud apply user interfaces that are both easy to learn and easy to use. Multimedia has big role in changing the mindset of a person in learning. Using multimedia, learners get easy to obtain information, adjust information and empower information. Therefore, multimedia is utilized by teachers in developing learning techniques to improve student learning outcomes. For students with self-directed learning, multimedia provides the ease and completeness of the courses in such a way that students can complete the learning independently both at school and at home without the guidance of teachers. The learning independence takes place in how students choose, absorb information, and follow the evaluation quickly and efficiently. The 2013 Curriculum 2013 for Vocational High School (SMK) requires teachers to create engaging teaching and learning activities that students enjoy in the classroom (also called invitation learning environment). The creation of learning activity environment is still problem for most teachers. Various researches reveal that teaching and learning activities will be more effective and easy when assisted by visual tools. Using multimedia, learning material can be presented more attractively that help students understand the material easily. The opposite is found in the learning activity environment who only rely on ordinary lectures. Usability is a quality level of multimedia with easy to learn, easy to use and encourages users to use it. The website Multimedia Interactive Learning for Mathematics SMK Class X is targeted object. Usability website in Multimedia Interactive Learning for Mathematics SMK Class X is important indicators to measure effectiveness, efficiency, and student satisfaction to access the functionality of website. This usability measurement should be done carefully before the design is implemented thoroughly. The only way to get test with high quality results is to start testing at the beginning of the design process and continuously testing each of the next steps. This research performs usability testing on of website by using WAMMI criterion (Website Analysis and Measurement Inventory) and will be focused on how convenience using the website application. Components of Attractiveness, Controllability, Efficiency, Helpfulness, and Learnability are applied. The website in Multimedia Interactive Learning for Mathematics SMK Class X can be in accordance with the purpose to be accepted by student to improve student learning outcomes. The results show that WAMMI method show the usability value of Multimedia Mathematics SMK Class X is about from 70% to 90%.
Berry, Donna L; Halpenny, Barbara; Bosco, Jaclyn L F; Bruyere, John; Sanda, Martin G
2015-07-24
The Personal Patient Profile-Prostate (P3P), a web-based decision aid, was demonstrated to reduce decisional conflict in English-speaking men with localized prostate cancer early after initial diagnosis. The purpose of this study was to explore and enhance usability and cultural appropriateness of a Spanish P3P by Latino men with a diagnosis of prostate cancer. P3P was translated to Spanish and back-translated by three native Spanish-speaking translators working independently. Spanish-speaking Latino men with a diagnosis of localized prostate cancer, who had made treatment decisions in the past 24 months, were recruited from two urban clinical care sites. Individual cognitive interviews were conducted by two bilingual research assistants as each participant used the Spanish P3P. Notes of user behavior, feedback, and answers to direct questions about comprehension, usability and perceived usefulness were analyzed and categorized. Seven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology. Revisions were prioritized to refine the usability and cultural and linguistic appropriateness of the decision aid. Usability issues were discovered that are potential barriers to effective decision support. Successful use of decision aids requires adaptation and testing beyond translation. Our findings led to revisions further refining the usability and linguistic and cultural appropriateness of Spanish P3P.
Redley, Bernice; Waugh, Rachael
2018-04-01
Nurse bedside handover quality is influenced by complex interactions related to the content, processes used and the work environment. Audit tools are seldom tested in 'real' settings. Examine the reliability, validity and usability of a quality improvement tool for audit of nurse bedside handover. Naturalistic, descriptive, mixed-methods. Six inpatient wards at a single large not-for-profit private health service in Victoria, Australia. Five nurse experts and 104 nurses involved in 199 change-of-shift bedside handovers. A focus group with experts and pilot test were used to examine content and face validity, and usability of the handover audit tool. The tool was examined for inter-rater reliability and usability using observation audits of handovers across six wards. Data were collected in 2013-2014. Two independent observers for 72 audits demonstrated acceptable inter-observer agreement for 27 (77%) items. Reliability was weak for items examining the handover environment. Seventeen items were not observed reflecting gaps in practices. Across 199 observation audits, gaps in nurse bedside handover practice most often related to process and environment, rather than content items. Usability was impacted by high observer burden, familiarity and non-specific illustrative behaviours. The reliability and validity of most items to audit handover content was acceptable. Gaps in practices for process and environment items were identified. Context specific exemplars and reducing the items used at each handover audit can enhance usability. Further research is needed to develop context specific exemplars and undertake additional reliability testing using a wide range of handover settings. CONTRIBUTION OF THE PAPER. Copyright © 2017 Elsevier Inc. All rights reserved.
Evaluating authentication options for mobile health applications in younger and older adults
Khan, Hassan; Hengartner, Urs; Ong, Stephanie; Logan, Alexander G.; Vogel, Daniel; Gebotys, Robert; Yang, Jilan
2018-01-01
Objective Apps promoting patient self-management may improve health outcomes. However, methods to secure stored information on mobile devices may adversely affect usability. We tested the reliability and usability of common user authentication techniques in younger and older adults. Methodology Usability testing was conducted in two age groups, 18 to 30 years and 50 years and older. After completing a demographic questionnaire, each participant tested four authentication options in random order: four-digit personal identification number (PIN), graphical password (GRAPHICAL), Android pattern-lock (PATTERN), and a swipe-style Android fingerprint scanner (FINGERPRINT). Participants rated each option using the Systems Usability Scale (SUS). Results A total of 59 older and 43 younger participants completed the study. Overall, PATTERN was the fastest option (3.44s), and PIN had the fewest errors per attempt (0.02). Participants were able to login using PIN, PATTERN, and GRAPHICAL at least 98% of the time. FINGERPRINT was the slowest (26.97s), had an average of 1.46 errors per attempt, and had a successful login rate of 85%. Overall, PIN and PATTERN had higher SUS scores than FINGERPRINT and GRAPHICAL. Compared to younger participants, older participants were also less likely to find PATTERN to be tiring, annoying or time consuming and less likely to consider PIN to be time consuming. Younger participants were more likely to rate GRAPHICAL as annoying, time consuming and tiring than older participants. Conclusions On mobile devices, PIN and pattern-lock outperformed graphical passwords and swipe-style fingerprints. All participants took longer to authenticate using the swipe-style fingerprint compared to other options. Older participants also took two to three seconds longer to authenticate using the PIN, pattern and graphical passwords though this did not appear to affect perceived usability. PMID:29300736
Evaluating authentication options for mobile health applications in younger and older adults.
Grindrod, Kelly; Khan, Hassan; Hengartner, Urs; Ong, Stephanie; Logan, Alexander G; Vogel, Daniel; Gebotys, Robert; Yang, Jilan
2018-01-01
Apps promoting patient self-management may improve health outcomes. However, methods to secure stored information on mobile devices may adversely affect usability. We tested the reliability and usability of common user authentication techniques in younger and older adults. Usability testing was conducted in two age groups, 18 to 30 years and 50 years and older. After completing a demographic questionnaire, each participant tested four authentication options in random order: four-digit personal identification number (PIN), graphical password (GRAPHICAL), Android pattern-lock (PATTERN), and a swipe-style Android fingerprint scanner (FINGERPRINT). Participants rated each option using the Systems Usability Scale (SUS). A total of 59 older and 43 younger participants completed the study. Overall, PATTERN was the fastest option (3.44s), and PIN had the fewest errors per attempt (0.02). Participants were able to login using PIN, PATTERN, and GRAPHICAL at least 98% of the time. FINGERPRINT was the slowest (26.97s), had an average of 1.46 errors per attempt, and had a successful login rate of 85%. Overall, PIN and PATTERN had higher SUS scores than FINGERPRINT and GRAPHICAL. Compared to younger participants, older participants were also less likely to find PATTERN to be tiring, annoying or time consuming and less likely to consider PIN to be time consuming. Younger participants were more likely to rate GRAPHICAL as annoying, time consuming and tiring than older participants. On mobile devices, PIN and pattern-lock outperformed graphical passwords and swipe-style fingerprints. All participants took longer to authenticate using the swipe-style fingerprint compared to other options. Older participants also took two to three seconds longer to authenticate using the PIN, pattern and graphical passwords though this did not appear to affect perceived usability.
Granata, C; Pino, M; Legouverneur, G; Vidal, J-S; Bidaud, P; Rigaud, A-S
2013-01-01
Socially assistive robotics for elderly care is a growing field. However, although robotics has the potential to support elderly in daily tasks by offering specific services, the development of usable interfaces is still a challenge. Since several factors such as age or disease-related changes in perceptual or cognitive abilities and familiarity with computer technologies influence technology use they must be considered when designing interfaces for these users. This paper presents findings from usability testing of two different services provided by a social assistive robot intended for elderly with cognitive impairment: a grocery shopping list and an agenda application. The main goal of this study is to identify the usability problems of the robot interface for target end-users as well as to isolate the human factors that affect the use of the technology by elderly. Socio-demographic characteristics and computer experience were examined as factors that could have an influence on task performance. A group of 11 elderly persons with Mild Cognitive Impairment and a group of 11 cognitively healthy elderly individuals took part in this study. Performance measures (task completion time and number of errors) were collected. Cognitive profile, age and computer experience were found to impact task performance. Participants with cognitive impairment achieved the tasks committing more errors than cognitively healthy elderly. Instead younger participants and those with previous computer experience were faster at completing the tasks confirming previous findings in the literature. The overall results suggested that interfaces and contents of the services assessed were usable by older adults with cognitive impairment. However, some usability problems were identified and should be addressed to better meet the needs and capacities of target end-users.
Zare Moayedi, Mahboobeh; Aslani, Azam; Fakhrahmad, Mostafa; Ezzatzadegan J, Shahrokh
2018-01-01
This study was conducted to develop an android based patient decision aid (PDA) as a self-care instrument for patients after kidney transplant and its usability evaluation. In this study, the systematic development process of Android-based self-care application for patients after kidney transplant based on Ottawa standard was included: scoping, assemble steering group, analysis of requirements, designing, develop of a prototype and system evaluation. The PDA is a self-triage system that will help early identification of risk symptoms in patients, and help manage them. System recommendations for risk signs are: Refer to the nearest hospital or healthcare center without delay, refer to the doctor and tell your doctor in the next visit. To identify patient care needs, a semi-structured interview with members of steering group, including patients and clinical experts, was conducted by the researchers. A prototype of the decision aid was made according to identified needs in the previous step. Finally, in order to evaluate its usability rate by using the System Usability Scale (SUS) questionnaire, it was used by exerts and patients. This study identified information needs, risk signs and steps that patients need to make appropriate decisions about them. The main capabilities of the decision aid are features such as reminders for appointment/test, time of taking medication, registration of symptoms, weight, blood pressure, body temperature, advising to patient in case of signs of risk, weight, blood pressure, body temperature and test results which were reported in the diagram. The mean score of system's usability evaluated by medical informatics specialists, clinicians, and patients were 88.33, 95, and 91. PDAs was usable and desirable from the point of view of medical informatics specialists, clinicians and patients.
2014-01-01
Background Nurses as the members of health care professionals need to improve their knowledge and competencies particularly in diabetes mellitus through continuing nursing education programs. E-learning is an indirect method of training that can meet nurses’ educational needs. This study is aimed at validating a web-based diabetes education program through measurement of nurses’ knowledge and clinical competency in diabetes and nurses’ perception about its usability and quality. Methods This Quasi-experimental research was conducted on a single group of 31 nurses employed in hospitals affiliated with Shiraz University of Medical Sciences. We used a 125 MCQ knowledge test and Objective Structured Clinical Exam (OSCE) to measure knowledge and clinical competency of nurses in diabetes before and after intervention. A Learning Management System (LMS) was designed to provide educational content in the form of 12 multimedia electronic modules, interactive tests; a forum and learning activities. Nurses were trained for two months in this system after which the post-test was administered. Each nurse completed two questionnaires for measurement of their perceptions on usability and quality. We used descriptive statistics for demographic and descriptive data analysis. Paired t-test was used to compare pre- and post-data using SPSS. Results The findings showed significant differences in knowledge scores (p < 0.001), total score of clinical competencies (p < 0.001), and all ten assessed clinical competencies. The range of ratings given by participants varied on the six usability variables of Web-based training (2.96-4.23 from 5) and eight quality variables of Web-based training (3.58-4.37 from 5). Conclusion Web-based education increased nurses’ knowledge and competencies in diabetes. They positively evaluated Web-based learning usability and quality. It is hoped that this course will have a positive clinical outcomes. PMID:26086025
Moattari, Marzieh; Moosavinasab, Elham; Dabbaghmanesh, Mohammad Hossein; ZarifSanaiey, Nahid
2014-01-01
Nurses as the members of health care professionals need to improve their knowledge and competencies particularly in diabetes mellitus through continuing nursing education programs. E-learning is an indirect method of training that can meet nurses' educational needs. This study is aimed at validating a web-based diabetes education program through measurement of nurses' knowledge and clinical competency in diabetes and nurses' perception about its usability and quality. This Quasi-experimental research was conducted on a single group of 31 nurses employed in hospitals affiliated with Shiraz University of Medical Sciences. We used a 125 MCQ knowledge test and Objective Structured Clinical Exam (OSCE) to measure knowledge and clinical competency of nurses in diabetes before and after intervention. A Learning Management System (LMS) was designed to provide educational content in the form of 12 multimedia electronic modules, interactive tests; a forum and learning activities. Nurses were trained for two months in this system after which the post-test was administered. Each nurse completed two questionnaires for measurement of their perceptions on usability and quality. We used descriptive statistics for demographic and descriptive data analysis. Paired t-test was used to compare pre- and post-data using SPSS. The findings showed significant differences in knowledge scores (p < 0.001), total score of clinical competencies (p < 0.001), and all ten assessed clinical competencies. The range of ratings given by participants varied on the six usability variables of Web-based training (2.96-4.23 from 5) and eight quality variables of Web-based training (3.58-4.37 from 5). Web-based education increased nurses' knowledge and competencies in diabetes. They positively evaluated Web-based learning usability and quality. It is hoped that this course will have a positive clinical outcomes.
Taddio, Anna; Shah, Vibhuti; Leung, Eman; Wang, Jane; Parikh, Chaitya; Smart, Sarah; Hetherington, Ross; Ipp, Moshe; Riddell, Rebecca Pillai; Sgro, Michael; Jovicic, Aleksandra; Franck, Linda
2013-02-08
Although numerous evidence-based and feasible interventions are available to treat pain from childhood vaccine injections, evidence indicates that children are not benefitting from this knowledge. Unrelieved vaccination pain puts children at risk for significant long-term harms including the development of needle fears and subsequent health care avoidance behaviours. Parents report that while they want to mitigate vaccination pain in their children, they lack knowledge about how to do so. An evidence-based clinical practice guideline for managing vaccination pain was recently developed in order to address this knowledge-to-care gap. Educational tools (pamphlet and video) for parents were included to facilitate knowledge transfer at the point of care. The objectives of this study were to evaluate usability and effectiveness in terms of knowledge acquisition from the pamphlet and video in parents of newly born infants. Mixed methods design. Following heuristic usability evaluation of the pamphlet and video, parents of newborn infants reviewed revised versions of both tools and participated in individual and group interviews and individual knowledge testing. The knowledge test comprised of 10 true/false questions about the effectiveness of various pain management interventions, and was administered at three time points: at baseline, after review of the pamphlet, and after review of the video. Three overarching themes were identified from the interviews regarding usability of these educational tools: receptivity to learning, accessibility to information, and validity of information. Parents' performance on the knowledge test improved (p≤0.001) from the baseline phase to after review of the pamphlet, and again from the pamphlet review phase to after review of the video. Using a robust testing process, we demonstrated usability and conceptual knowledge acquisition from a parent-directed educational pamphlet and video about management of vaccination pain. Future studies are planned to determine the impact of these educational tools when introduced in clinical settings on parent behaviors during infant vaccinations.
Tielman, Myrthe L; Neerincx, Mark A; Bidarra, Rafael; Kybartas, Ben; Brinkman, Willem-Paul
2017-08-01
Although post-traumatic stress disorder (PTSD) is well treatable, many people do not get the desired treatment due to barriers to care (such as stigma and cost). This paper presents a system that bridges this gap by enabling patients to follow therapy at home. A therapist is only involved remotely, to monitor progress and serve as a safety net. With this system, patients can recollect their memories in a digital diary and recreate them in a 3D WorldBuilder. Throughout the therapy, a virtual agent is present to inform and guide patients through the sessions, employing an ontology-based question module for recollecting traumatic memories to further elicit a detailed memory recollection. In a usability study with former PTSD patients (n = 4), these questions were found useful for memory recollection. Moreover, the usability of the whole system was rated positively. This system has the potential to be a valuable addition to the spectrum of PTSD treatments, offering a novel type of home therapy assisted by a virtual agent.
ERIC Educational Resources Information Center
Erickson, William; Trerise, Sharon; Lee, Camille; VanLooy, Sara; Knowlton, Samuel; Bruyère, Susanne
2013-01-01
Thirty community college websites were evaluated for compliance with federal web accessibility standards found in Section 508 of the Rehabilitation Act of 1973 (29 U.S.C. 794d). Two typical sites were tested for usability by individuals with visual impairments, individuals with reading-related learning disabilities (LD), and a control group of…
Does Your Library's Web Site Pass the Usability Test? Online Treasures
ERIC Educational Resources Information Center
Balas, Janet L.
2005-01-01
In days that seem very long ago, when the card catalog was the only way to search a library's collection, there was very little debate about the usability of the catalog. Librarians were most concerned about properly formatting catalog cards and, of course, ensuring that the cards were filed correctly. Today, the card catalog has been replaced in…
Eriksson, J; Ek, A; Johansson, G
2000-03-01
A software prototype to support the planning process for adapting home and work environments for people with physical disabilities was designed and later evaluated. The prototype exploits low-cost three-dimensional (3-D) graphics products in the home computer market. The essential features of the prototype are: interactive rendering with optional hardware acceleration, interactive walk-throughs, direct manipulation tools for moving objects and measuring distances, and import of 3-D-objects from a library. A usability study was conducted, consisting of two test sessions (three weeks apart) and a final interview. The prototype was then tested and evaluated by representatives of future users: five occupational therapist students, and four persons with physical disability, with no previous experience of the prototype. Emphasis in the usability study was placed on the prototype's efficiency and learnability. We found that it is possible to realise a planning tool for environmental adaptations, both regarding usability and technical efficiency. The usability evaluation confirms our findings from previous case studies, regarding the relevance and positive attitude towards this kind of planning tool. Although the prototype was found to be satisfactorily efficient for the basic tasks, the paper presents several suggestions for improvement of future prototype versions.
Pigini, Lucia; Bovi, Gabriele; Panzarino, Claudia; Gower, Valerio; Ferratini, Maurizio; Andreoni, Giuseppe; Sassi, Roberto; Rivolta, Massimo W; Ferrarin, Maurizio
2017-01-01
The increase in life expectancy is accompanied by a growing number of elderly subjects affected by chronic comorbidities, a health issue which also implies important socioeconomic consequences. Shifting from hospital or community dwelling care towards a home personalized healthcare paradigm would promote active aging with a better quality of life, along with a reduction in healthcare-related costs. The aim of the SMARTA project was to develop and test an innovative personal health system integrating standard sensors as well as innovative wearable and environmental sensors to allow home telemonitoring of vital parameters and detection of anomalies in daily activities, thus supporting active aging through remote healthcare. A first phase of the project consisted in the definition of the health and environmental parameters to be monitored (electrocardiography and actigraphy, blood pressure and oxygen saturation, weight, ear temperature, glycemia, home interaction monitoring - water tap, refrigerator, and dishwasher), the feedbacks for the clinicians, and the reminders for the patients. It was followed by a technical feasibility analysis leading to an iterative process of prototype development, sensor integration, and testing. Once the prototype had reached an advanced stage of development, a group of 32 volunteers - including 15 healthy adult subjects, 13 elderly people with cardiac diseases, and 4 clinical operators - was recruited to test the system in a real home setting, in order to evaluate both technical reliability and user perception of the system in terms of effectiveness, usability, acceptance, and attractiveness. The testing in a real home setting showed a good perception of the SMARTA system and its functionalities both by the patients and by the clinicians, who appreciated the user interface and the clinical governance system. The moderate system reliability of 65-70% evidenced some technical issues, mainly related to sensor integration, while the patient's user interface showed excellent reliability (100%). Both elderly people and clinical operators considered the SMARTA system a promising and attractive tool for improving patients' healthcare while reducing related costs and preserving quality of life. However, the moderate reliability of the system should prompt further technical developments in terms of sensor integration and usability of the clinical operator's user interface. © 2017 S. Karger AG, Basel.
Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps
Silfee, Valerie J; Waring, Molly E; Boudreaux, Edwin D; Sadasivam, Rajani S; Mullen, Sean P; Carey, Jennifer L; Hayes, Rashelle B; Ding, Eric Y; Bennett, Gary G; Pagoto, Sherry L
2017-01-01
Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps. PMID:29254914
NASA Astrophysics Data System (ADS)
Luhur, H. S.; Widjaja, N. D.
2014-03-01
This paper is focusing on the development of a mobile application for searching restaurants and promotions with location based and social networking features. The main function of the application is to search restaurant information. Other functions are also available in this application such as add restaurant, add promotion, add photo, add food review, and other features including social networking features. The restaurant and promotion searching application will be developed under Android platform. Upon completion of this paper, heuristic evaluation and usability testing have been conducted. The result of both testing shows that the application is highly usable. Even though there are some usability problems discovered, the problems can be eliminated immediately by implementing the recommendations from the expert evaluators and the users as the testers of the application. Further improvement made to the application will ensure that the application can really be beneficial for the users of the application.
Converged Infrastructure for Emerging Regions - A Research Agenda
NASA Astrophysics Data System (ADS)
Chevrollier, Nicolas; Zidbeck, Juha; Ntlatlapa, Ntsibane; Simsek, Burak; Marikar, Achim
In remote parts of Africa, the lack of energy supply, of wired infrastructure, of trained personnel and the limitation in OPEX and CAPEX impose stringent requirements on the network building blocks that support the communication infrastructure. Consequently, in this promising but untapped market, the research aims at designing and implementing energy-efficient, robust, reliable and affordable wide heterogeneous wireless mesh networks to connect geographically very large areas in a challenged environment. This paper proposes a solution that is aimed at enhancing the usability of Internet services in the harsh target environment and especially how the end-users experience the reliability of these services.
RemoTable: Sharing Daily Activities and Moods Using Smart Furniture.
Wallbaum, Torben; Heuten, Wilko; Boll, Susanne
2016-01-01
Social Interaction and the feeling of emotional closeness to beloved ones is mainly driven by the communication with each other. For patients suffering from a serious disease due to intense mood changes, it is difficult to keep regular contact with relatives. This affects the need for direct and verbal communication with relatives. To continue the participation in each others lives, we have developed a concept to share daily activities, current moods and presence information using a smart living room table. A first lab study with a prototype showed promising results with regard to expressiveness, joy of use, and usability.
A usability evaluation of medical software at an expert conference setting.
Bond, Raymond Robert; Finlay, Dewar D; Nugent, Chris D; Moore, George; Guldenring, Daniel
2014-01-01
A usability test was employed to evaluate two medical software applications at an expert conference setting. One software application is a medical diagnostic tool (electrocardiogram [ECG] viewer) and the other is a medical research tool (electrode misplacement simulator [EMS]). These novel applications have yet to be adopted by the healthcare domain, thus, (1) we wanted to determine the potential user acceptance of these applications and (2) we wanted to determine the feasibility of evaluating medical diagnostic and medical research software at a conference setting as opposed to the conventional laboratory setting. The medical diagnostic tool (ECG viewer) was evaluated using seven delegates and the medical research tool (EMS) was evaluated using 17 delegates that were recruited at the 2010 International Conference on Computing in Cardiology. Each delegate/participant was required to use the software and undertake a set of predefined tasks during the session breaks at the conference. User interactions with the software were recorded using screen-recording software. The 'think-aloud' protocol was also used to elicit verbal feedback from the participants whilst they attempted the pre-defined tasks. Before and after each session, participants completed a pre-test and a post-test questionnaire respectively. The average duration of a usability session at the conference was 34.69 min (SD=10.28). However, taking into account that 10 min was dedicated to the pre-test and post-test questionnaires, the average time dedication to user interaction of the medical software was 24.69 min (SD=10.28). Given we have shown that usability data can be collected at conferences, this paper details the advantages of conference-based usability studies over the laboratory-based approach. For example, given delegates gather at one geographical location, a conference-based usability evaluation facilitates recruitment of a convenient sample of international subject experts. This would otherwise be very expensive to arrange. A conference-based approach also allows for data to be collected over a few days as opposed to months by avoiding administration duties normally involved in laboratory based approach, e.g. mailing invitation letters as part of a recruitment campaign. Following analysis of the user video recordings, 41 (previously unknown) use errors were identified in the advanced ECG viewer and 29 were identified in the EMS application. All use errors were given a consensus severity rating from two independent usability experts. Out of a rating scale of 4 (where 1=cosmetic and 4=critical), the average severity rating for the ECG viewer was 2.24 (SD=1.09) and the average severity rating for the EMS application was 2.34 (SD=0.97). We were also able to extract task completion rates and times from the video recordings to determine the effectiveness of the software applications. For example, six out of seven tasks were completed by all participants when using both applications. This statistic alone suggests both applications already have a high degree of usability. As well as extracting data from the video recordings, we were also able to extract data from the questionnaires. Using a semantic differential scale (where 1=poor and 5=excellent), delegates highly rated the 'responsiveness', 'usefulness', 'learnability' and the 'look and feel' of both applications. This study has shown the potential user acceptance and user-friendliness of the novel EMS and the ECG viewer applications within the healthcare domain. It has also shown that both medical diagnostic software and medical research software can be evaluated for their usability at an expert conference setting. The primary advantage of a conference-based usability evaluation over a laboratory-based evaluation is the high concentration of experts at one location, which is convenient, less time consuming and less expensive. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.
Zhang, Xiao C; Bermudez, Ana M; Reddy, Pranav M; Sarpatwari, Ravi R; Chheng, Darin B; Mezoian, Taylor J; Schwartz, Victoria R; Simmons, Quinneil J; Jay, Gregory D; Kobayashi, Leo
2017-03-01
A stable and readily accessible work surface for bedside medical procedures represents a valuable tool for acute care providers. In emergency department (ED) settings, the design and implementation of traditional Mayo stands and related surface devices often limit their availability, portability, and usability, which can lead to suboptimal clinical practice conditions that may affect the safe and effective performance of medical procedures and delivery of patient care. We designed and built a novel, open-source, portable, bedside procedural surface through an iterative development process with use testing in simulated and live clinical environments. The procedural surface development project was conducted between October 2014 and June 2016 at an academic referral hospital and its affiliated simulation facility. An interdisciplinary team of emergency physicians, mechanical engineers, medical students, and design students sought to construct a prototype bedside procedural surface out of off-the-shelf hardware during a collaborative university course on health care design. After determination of end-user needs and core design requirements, multiple prototypes were fabricated and iteratively modified, with early variants featuring undermattress stabilizing supports or ratcheting clamp mechanisms. Versions 1 through 4 underwent 2 hands-on usability-testing simulation sessions; version 5 was presented at a design critique held jointly by a panel of clinical and industrial design faculty for expert feedback. Responding to select feedback elements over several surface versions, investigators arrived at a near-final prototype design for fabrication and use testing in a live clinical setting. This experimental procedural surface (version 8) was constructed and then deployed for controlled usability testing against the standard Mayo stands in use at the study site ED. Clinical providers working in the ED who opted to participate in the study were provided with the prototype surface and just-in-time training on its use when performing bedside procedures. Subjects completed the validated 10-point System Usability Scale postshift for the surface that they had used. The study protocol was approved by the institutional review board. Multiple prototypes and recursive design revisions resulted in a fully functional, portable, and durable bedside procedural surface that featured a stainless steel tray and intuitive hook-and-lock mechanisms for attachment to ED stretcher bed rails. Forty-two control and 40 experimental group subjects participated and completed questionnaires. The median System Usability Scale score (out of 100; higher scores associated with better usability) was 72.5 (interquartile range [IQR] 51.3 to 86.3) for the Mayo stand; the experimental surface was scored at 93.8 (IQR 84.4 to 97.5 for a difference in medians of 17.5 (95% confidence interval 10 to 27.5). Subjects reported several usability challenges with the Mayo stand; the experimental surface was reviewed as easy to use, simple, and functional. In accordance with experimental live environment deployment, questionnaire responses, and end-user suggestions, the project team finalized the design specification for the experimental procedural surface for open dissemination. An iterative, interdisciplinary approach was used to generate, evaluate, revise, and finalize the design specification for a new procedural surface that met all core end-user requirements. The final surface design was evaluated favorably on a validated usability tool against Mayo stands when use tested in simulated and live clinical settings. Copyright © 2016 American College of Emergency Physicians. Published by Elsevier Inc. All rights reserved.
Invited Article: Digital beam-forming imaging riometer systems
NASA Astrophysics Data System (ADS)
Honary, Farideh; Marple, Steve R.; Barratt, Keith; Chapman, Peter; Grill, Martin; Nielsen, Erling
2011-03-01
The design and operation of a new generation of digital imaging riometer systems developed by Lancaster University are presented. In the heart of the digital imaging riometer is a field-programmable gate array (FPGA), which is used for the digital signal processing and digital beam forming, completely replacing the analog Butler matrices which have been used in previous designs. The reconfigurable nature of the FPGA has been exploited to produce tools for remote system testing and diagnosis which have proven extremely useful for operation in remote locations such as the Arctic and Antarctic. Different FPGA programs enable different instrument configurations, including a 4 × 4 antenna filled array (producing 4 × 4 beams), an 8 × 8 antenna filled array (producing 7 × 7 beams), and a Mills cross system utilizing 63 antennas producing 556 usable beams. The concept of using a Mills cross antenna array for riometry has been successfully demonstrated for the first time. The digital beam forming has been validated by comparing the received signal power from cosmic radio sources with results predicted from the theoretical beam radiation pattern. The performances of four digital imaging riometer systems are compared against each other and a traditional imaging riometer utilizing analog Butler matrices. The comparison shows that digital imaging riometer systems, with independent receivers for each antenna, can obtain much better measurement precision for filled arrays or much higher spatial resolution for the Mills cross configuration when compared to existing imaging riometer systems.
NASA Astrophysics Data System (ADS)
Hafner, D.
2015-09-01
The application of ground-based boresight sources for calibration and testing of tracking antennas usually entails various difficulties, mostly due to unwanted ground effects. To avoid this problem, DLR MORABA developed a small, lightweight, frequency-adjustable S-band boresight source, mounted on a small remote-controlled multirotor aircraft. Highly accurate GPS-supported, position and altitude control functions allow both, very steady positioning of the aircraft in mid-air, and precise waypoint-based, semi-autonomous flights. In contrast to fixed near-ground boresight sources this flying setup enables to avoid obstructions in the Fresnel zone between source and antenna. Further, it minimizes ground reflections and other multipath effects which can affect antenna calibration. In addition, the large operating range of a flying boresight simplifies measurements in the far field of the antenna and permits undisturbed antenna pattern tests. A unique application is the realistic simulation of sophisticated flight paths, including overhead tracking and demanding trajectories of fast objects such as sounding rockets. Likewise, dynamic tracking tests are feasible which provide crucial information about the antenna pedestal performance — particularly at high elevations — and reveal weaknesses in the autotrack control loop of tracking antenna systems. During acceptance tests of MORABA's new tracking antennas, a manned aircraft was never used, since the Flying Boresight surpassed all expectations regarding usability, efficiency, and precision. Hence, it became an integral part of MORABA's standard antenna setup and calibration procedures.
[Evaluation of telemedicine systems for impacted third molars diagnosis].
Duka, Milos; Mihailović, Branko; Miladinović, Milan; Janković, Aleksandar; Vujicić, Biljana
2009-12-01
BACKGROUND/AIM. In the last twenty years significant advances have been made in the fields of information and telecommunication technology in health care applications, with a positive impact on the health care practice. The need for remote diagnosis and planning of interventions is of special importance in military health care, and health management of immobile persons, and those with special needs. In cases such as these, availability of specialist health care is mainly limited by geographic and financial factors. The aim of this study was to investigate practical usability of telemedicine approaches in everyday management of oral surgery patients in terms of reliability of established diagnosis and indications for oral surgery treatment of the third molars. Our experimental randomized study enrolled 432 randomly selected patients of both genders, aged 20 to 87 years, undergoing panoramic radiography for some reason in the Centre for Dental Radiography in Belgrade. In addition to radiography, photographs of the face and mouth cavity were taken. These images were uploaded to the web server specially dedicated to the study purposes, and then transmitted to teledentists, i.e. oral surgeons, who made remote diagnoses. Diagnostic agreement was determined by way of the Cohen's kappa coefficient, and diagnostic sensitivity (SE), specificity (SP), and effectiveness (EFF) were also established. Statistical significance was determined and comparisons performed by using the z-test, and testing of non-parametric characteristics by using the McNemar's chi2 test for p = 0.05 significance cut-off. The results obtained by analyzed images and diagnostic assessment of the clinical diagnosis (kappa = 0.99, SE = 99%, SP = 99%, EFF = 99%, for 95% CI) indicate an almost complete diagnostic agreement. The differences in diagnosis were not statistically significant. Diagnostic assessment of the clinical diagnosis of impacted or semi-impacted third molars assisted by the telemedicine approach was equal to the real-time assessment of clinical diagnosis. Telemedicine, and teledentistry as its branch, represent the present and even more the future of this field of health care.
A study of usability principles and interface design for mobile e-books.
Wang, Chao-Ming; Huang, Ching-Hua
2015-01-01
This study examined usability principles and interface designs in order to understand the relationship between the intentions of mobile e-book interface designs and users' perceptions. First, this study summarised 4 usability principles and 16 interface attributes, in order to conduct usability testing and questionnaire survey by referring to Nielsen (1993), Norman (2002), and Yeh (2010), who proposed the usability principles. Second, this study used the interviews to explore the perceptions and behaviours of user operations through senior users of multi-touch prototype devices. The results of this study are as follows: (1) users' behaviour of operating an interactive interface is related to user prior experience; (2) users' rating of the visibility principle is related to users' subjective perception but not related to user prior experience; however, users' ratings of the ease, efficiency, and enjoyment principles are related to user prior experience; (3) the interview survey reveals that the key attributes affecting users' behaviour of operating an interface include aesthetics, achievement, and friendliness. This study conducts experiments to explore the effects of users’ prior multi-touch experience on users’ behaviour of operating a mobile e-book interface and users’ rating of usability principles. Both qualitative and quantitative data analyses were performed. By applying protocol analysis, key attributes affecting users’ behaviour of operation were determined.
A health literacy and usability heuristic evaluation of a mobile consumer health application.
Monkman, Helen; Kushniruk, Andre
2013-01-01
Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.
ERIC Educational Resources Information Center
Fry, Amy; Rich, Linda
2011-01-01
In early 2010, library staff at Bowling Green State University (BGSU) in Ohio designed and conducted a usability study of key parts of the library web site, focusing on the web pages generated by the library's electronic resources management system (ERM) that list and describe the library's databases. The goal was to discover how users find and…
Rhebergen, Martijn D F; Hulshof, Carel T J; Lenderink, Annet F; van Dijk, Frank J H
2010-10-22
Common information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions. We applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use. Most features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements. This network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition to existing information facilities in the field of OSH, but also to other healthcare fields struggling with how to answer questions from people in practice with high quality information. In the near future, we will focus on the use of the tool and its effects on information and knowledge dissemination.
Virtual Sliding QWERTY: A new text entry method for smartwatches using Tap-N-Drag.
Cha, Jae-Min; Choi, Eunjung; Lim, Jihyoun
2015-11-01
A smaller screen of smartwatches compare to conventional mobile devices such as PDAs and smartphones is one of the main factors that makes users to input texts difficult. However, several studies have only proposed a concept for entering texts for smartwatches without usability tests while other studies showed low text input performance. In this study, we proposed a new text entry method called Virtual Sliding QWERTY (VSQ) which utilizes a virtual qwerty-layout keyboard and a 'Tap-N-Drag' method to move the keyboard to the desired position. In addition, to verify VSQ we conducted a usability test with 20 participants for a combination of 5 key sizes and 4 CD-gains. As a result, VSQ achieved an average of 11.9 Words per Minute which was higher than previous studies. In particular, VSQ at 5 × 5 key size and 2×, or 3× CD-gain had the highest performance in terms of the quantitative and qualitative usability test. Copyright © 2015 Elsevier Ltd and The Ergonomics Society. All rights reserved.
Park, Joo Hyun; Son, Ji Young; Kim, Sun
2012-09-01
The purpose of this study was to establish an e-learning system to support learning in medical education and identify solutions for improving the system. A learning management system (LMS) and computer-based test (CBT) system were established to support e-learning for medical students. A survey of 219 first- and second-grade medical students was administered. The questionnaire included 9 forced choice questions about the usability of system and 2 open-ended questions about necessary improvements to the system. The LMS consisted of a class management, class evaluation, and class attendance system. CBT consisted of a test management, item bank, and authoring tool system. The results of the survey showed a high level of satisfaction in all system usability items except for stability. Further, the advantages of the e-learning system were ensuring information accessibility, providing constant feedback, and designing an intuitive interface. Necessary improvements to the system were stability, user control, readability, and diverse device usage. Based on the findings, suggestions for developing an e-learning system to improve usability by medical students and support learning effectively are recommended.
Chrimes, Dillon; Kushniruk, Andre; Kitos, Nicole R.
2014-01-01
Purpose Usability testing can be used to evaluate human computer interaction (HCI) and communication in shared decision making (SDM) for patient-provider behavioral change and behavioral contracting. Traditional evaluations of usability using scripted or mock patient scenarios with think-aloud protocol analysis provide a to identify HCI issues. In this paper we describe the application of these methods in the evaluation of the Avoiding Diabetes Thru Action Plan Targeting (ADAPT) tool, and test the usability of the tool to support the ADAPT framework for integrated care counseling of pre-diabetes. The think-aloud protocol analysis typically does not provide an assessment of how patient-provider interactions are effected in “live” clinical workflow or whether a tool is successful. Therefore, “Near-live” clinical simulations involving applied simulation methods were used to compliment the think-aloud results. This complementary usability technique was used to test the end-user HCI and tool performance by more closely mimicking the clinical workflow and capturing interaction sequences along with assessing the functionality of computer module prototypes on clinician workflow. We expected this method to further complement and provide different usability findings as compared to think-aloud analysis. Together, this mixed method evaluation provided comprehensive and realistic feedback for iterative refinement of the ADAPT system prior to implementation. Methods The study employed two phases of testing of a new interactive ADAPT tool that embedded an evidence-based shared goal setting component into primary care workflow for dealing with pre-diabetes counseling within a commercial physician office electronic health record (EHR). Phase I applied usability testing that involved “think-aloud” protocol analysis of 8 primary care providers interacting with several scripted clinical scenarios. Phase II used “near-live” clinical simulations of 5 providers interacting with standardized trained patient actors enacting the clinical scenario of counseling for pre-diabetes, each of whom had a pedometer that recorded the number of steps taken over a week. In both phases, all sessions were audio-taped and motion screen-capture software was activated for onscreen recordings. Transcripts were coded using iterative qualitative content analysis methods. Results In Phase I, the impact of the components and layout of ADAPT on user’s Navigation, Understandability, and Workflow were associated with the largest volume of negative comments (i.e. approximately 80% of end-user commentary), while Usability and Content of ADAPT were representative of more positive than negative user commentary. The heuristic category of Usability had a positive-to-negative comment ratio of 2.1, reflecting positive perception of the usability of the tool, its functionality, and overall co-productive utilization of ADAPT. However, there were mixed perceptions about content (i.e., how the information was displayed, organized and described in the tool). In Phase II, the duration of patient encounters was approximately 10 minutes with all of the Patient Instructions (prescriptions) and behavioral contracting being activated at the end of each visit. Upon activation, providers accepted the pathway prescribed by the tool 100% of the time and completed all the fields in the tool in the simulation cases. Only 14% of encounter time was spent using the functionality of the ADAPT tool in terms of keystrokes and entering relevant data. The rest of the time was spent on communication and dialogue to populate the patient instructions. In all cases, the interaction sequence of reviewing and discussing exercise and diet of the patient was linked to the functionality of the ADAPT tool in terms of monitoring, response-efficacy, self-efficacy, and negotiation in the patient-provider dialogue. There was a change from one-way dialogue to two-way dialogue and negotiation that ended in a behavioral contract. This change demonstrated the tool’s sequence, which supported recording current exercise and diet followed by a diet and exercise goal setting procedure to reduce the risk of diabetes onset. Conclusions This study demonstrated that “think-aloud” protocol analysis with “near-live” clinical simulations provided a successful usability evaluation of a new primary care pre-diabetes shared goal setting tool. Each phase of the study provided complementary observations on problems with the new onscreen tool and was used to show the influence of the ADAPT framework on the usability, workflow integration, and communication between the patient and provider. The think-aloud tests with the provider showed the tool can be used according to the ADAPT framework (exercise-to-diet behavior change and tool utilization), while the clinical simulations revealed the ADAPT framework to realistically support patient-provider communication to obtain behavioral change contract. SDM interactions and mechanisms affecting protocol-based care can be more completely captured by combining “near-live” clinical simulations with traditional “think-aloud analysis” which augments clinician utilization. More analysis is required to verify if the rich communication actions found in Phase II compliment clinical workflows. PMID:24981988
Chrimes, Dillon; Kitos, Nicole R; Kushniruk, Andre; Mann, Devin M
2014-09-01
Usability testing can be used to evaluate human-computer interaction (HCI) and communication in shared decision making (SDM) for patient-provider behavioral change and behavioral contracting. Traditional evaluations of usability using scripted or mock patient scenarios with think-aloud protocol analysis provide a way to identify HCI issues. In this paper we describe the application of these methods in the evaluation of the Avoiding Diabetes Thru Action Plan Targeting (ADAPT) tool, and test the usability of the tool to support the ADAPT framework for integrated care counseling of pre-diabetes. The think-aloud protocol analysis typically does not provide an assessment of how patient-provider interactions are effected in "live" clinical workflow or whether a tool is successful. Therefore, "Near-live" clinical simulations involving applied simulation methods were used to compliment the think-aloud results. This complementary usability technique was used to test the end-user HCI and tool performance by more closely mimicking the clinical workflow and capturing interaction sequences along with assessing the functionality of computer module prototypes on clinician workflow. We expected this method to further complement and provide different usability findings as compared to think-aloud analysis. Together, this mixed method evaluation provided comprehensive and realistic feedback for iterative refinement of the ADAPT system prior to implementation. The study employed two phases of testing of a new interactive ADAPT tool that embedded an evidence-based shared goal setting component into primary care workflow for dealing with pre-diabetes counseling within a commercial physician office electronic health record (EHR). Phase I applied usability testing that involved "think-aloud" protocol analysis of eight primary care providers interacting with several scripted clinical scenarios. Phase II used "near-live" clinical simulations of five providers interacting with standardized trained patient actors enacting the clinical scenario of counseling for pre-diabetes, each of whom had a pedometer that recorded the number of steps taken over a week. In both phases, all sessions were audio-taped and motion screen-capture software was activated for onscreen recordings. Transcripts were coded using iterative qualitative content analysis methods. In Phase I, the impact of the components and layout of ADAPT on user's Navigation, Understandability, and Workflow were associated with the largest volume of negative comments (i.e. approximately 80% of end-user commentary), while Usability and Content of ADAPT were representative of more positive than negative user commentary. The heuristic category of Usability had a positive-to-negative comment ratio of 2.1, reflecting positive perception of the usability of the tool, its functionality, and overall co-productive utilization of ADAPT. However, there were mixed perceptions about content (i.e., how the information was displayed, organized and described in the tool). In Phase II, the duration of patient encounters was approximately 10 min with all of the Patient Instructions (prescriptions) and behavioral contracting being activated at the end of each visit. Upon activation, providers accepted the pathway prescribed by the tool 100% of the time and completed all the fields in the tool in the simulation cases. Only 14% of encounter time was spent using the functionality of the ADAPT tool in terms of keystrokes and entering relevant data. The rest of the time was spent on communication and dialog to populate the patient instructions. In all cases, the interaction sequence of reviewing and discussing exercise and diet of the patient was linked to the functionality of the ADAPT tool in terms of monitoring, response-efficacy, self-efficacy, and negotiation in the patient-provider dialog. There was a change from one-way dialog to two-way dialog and negotiation that ended in a behavioral contract. This change demonstrated the tool's sequence, which supported recording current exercise and diet followed by a diet and exercise goal setting procedure to reduce the risk of diabetes onset. This study demonstrated that "think-aloud" protocol analysis with "near-live" clinical simulations provided a successful usability evaluation of a new primary care pre-diabetes shared goal setting tool. Each phase of the study provided complementary observations on problems with the new onscreen tool and was used to show the influence of the ADAPT framework on the usability, workflow integration, and communication between the patient and provider. The think-aloud tests with the provider showed the tool can be used according to the ADAPT framework (exercise-to-diet behavior change and tool utilization), while the clinical simulations revealed the ADAPT framework to realistically support patient-provider communication to obtain behavioral change contract. SDM interactions and mechanisms affecting protocol-based care can be more completely captured by combining "near-live" clinical simulations with traditional "think-aloud analysis" which augments clinician utilization. More analysis is required to verify if the rich communication actions found in Phase II compliment clinical workflows. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.
Design and implementation of a UNIX based distributed computing system
DOE Office of Scientific and Technical Information (OSTI.GOV)
Love, J.S.; Michael, M.W.
1994-12-31
We have designed, implemented, and are running a corporate-wide distributed processing batch queue on a large number of networked workstations using the UNIX{reg_sign} operating system. Atlas Wireline researchers and scientists have used the system for over a year. The large increase in available computer power has greatly reduced the time required for nuclear and electromagnetic tool modeling. Use of remote distributed computing has simultaneously reduced computation costs and increased usable computer time. The system integrates equipment from different manufacturers, using various CPU architectures, distinct operating system revisions, and even multiple processors per machine. Various differences between the machines have tomore » be accounted for in the master scheduler. These differences include shells, command sets, swap spaces, memory sizes, CPU sizes, and OS revision levels. Remote processing across a network must be performed in a manner that is seamless from the users` perspective. The system currently uses IBM RISC System/6000{reg_sign}, SPARCstation{sup TM}, HP9000s700, HP9000s800, and DEC Alpha AXP{sup TM} machines. Each CPU in the network has its own speed rating, allowed working hours, and workload parameters. The system if designed so that all of the computers in the network can be optimally scheduled without adversely impacting the primary users of the machines. The increase in the total usable computational capacity by means of distributed batch computing can change corporate computing strategy. The integration of disparate computer platforms eliminates the need to buy one type of computer for computations, another for graphics, and yet another for day-to-day operations. It might be possible, for example, to meet all research and engineering computing needs with existing networked computers.« less
Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Alman, Benjamin; Hopyan, Sevan; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L; Orr, Mike
2013-01-01
Background Pain is one of the most common and distressing symptoms reported by adolescents with cancer. Despite advancements in pain assessment and management research, pain due to cancer and/or its treatments continues to be poorly managed. Our research group has developed a native iPhone application (app) called Pain Squad to tackle the problem of poorly managed pain in the adolescent with cancer group. The app functions as an electronic pain diary and is unique in its ability to collect data on pain intensity, duration, location, and the impact pain has on an adolescent’s life (ie, relationships, school work, sleep, mood). It also evaluates medications and other physical and psychological pain management strategies used. Users are prompted twice daily at configurable times to complete 20 questions characterizing their pain and the app transmits results to a database for aggregate reporting through a Web interface. Each diary entry represents a pain case filed by an adolescent with cancer and a reward system (ie, moving up through law-enforcement team ranks, built-in videotaped acknowledgements from fictitious officers) encourages consistent use of the diary. Objective Our objective was to design, develop, and test the usability, feasibility, compliance, and satisfaction of a game-based smartphone pain assessment tool for adolescents with cancer. Methods We used both low- and high-fidelity qualitative usability testing with qualitative semi-structured, audio-taped interviews and iterative cycles to design and refine the iPhone based Pain Squad app. Qualitative thematic analysis of interviews using constant comparative methodology captured emergent themes related to app usability. Content validity was assessed using question importance-rating surveys completed by participants. Compliance and satisfaction data were collected following a 2-week feasibility trial where users were alarmed to record their pain twice daily on the app. Results Thematic analysis of usability interviews showed the app to be appealing overall to adolescents. Analyses of both low- and high-fidelity testing resulted in minor revisions to the app to refine the theme and improve its usability. Adolescents resoundingly endorsed the game-based nature of the app and its virtual reward system. The importance of app pain diary questions was established by content validity analysis. Compliance with the app, assessed during feasibility testing, was high (mean 81%, SD 22%) and adolescents from this phase of the study found the app likeable, easy to use, and not bothersome to complete. Conclusions A multifaceted usability approach demonstrated how the Pain Squad app could be made more appealing to children and adolescents with cancer. The game-based nature and built-in reward system of the app was appealing to adolescents and may have resulted in the high compliance rates and satisfaction ratings observed during clinical feasibility testing. PMID:23475457
Stinson, Jennifer N; Jibb, Lindsay A; Nguyen, Cynthia; Nathan, Paul C; Maloney, Anne Marie; Dupuis, L Lee; Gerstle, J Ted; Alman, Benjamin; Hopyan, Sevan; Strahlendorf, Caron; Portwine, Carol; Johnston, Donna L; Orr, Mike
2013-03-08
Pain is one of the most common and distressing symptoms reported by adolescents with cancer. Despite advancements in pain assessment and management research, pain due to cancer and/or its treatments continues to be poorly managed. Our research group has developed a native iPhone application (app) called Pain Squad to tackle the problem of poorly managed pain in the adolescent with cancer group. The app functions as an electronic pain diary and is unique in its ability to collect data on pain intensity, duration, location, and the impact pain has on an adolescent's life (ie, relationships, school work, sleep, mood). It also evaluates medications and other physical and psychological pain management strategies used. Users are prompted twice daily at configurable times to complete 20 questions characterizing their pain and the app transmits results to a database for aggregate reporting through a Web interface. Each diary entry represents a pain case filed by an adolescent with cancer and a reward system (ie, moving up through law-enforcement team ranks, built-in videotaped acknowledgements from fictitious officers) encourages consistent use of the diary. Our objective was to design, develop, and test the usability, feasibility, compliance, and satisfaction of a game-based smartphone pain assessment tool for adolescents with cancer. We used both low- and high-fidelity qualitative usability testing with qualitative semi-structured, audio-taped interviews and iterative cycles to design and refine the iPhone based Pain Squad app. Qualitative thematic analysis of interviews using constant comparative methodology captured emergent themes related to app usability. Content validity was assessed using question importance-rating surveys completed by participants. Compliance and satisfaction data were collected following a 2-week feasibility trial where users were alarmed to record their pain twice daily on the app. Thematic analysis of usability interviews showed the app to be appealing overall to adolescents. Analyses of both low- and high-fidelity testing resulted in minor revisions to the app to refine the theme and improve its usability. Adolescents resoundingly endorsed the game-based nature of the app and its virtual reward system. The importance of app pain diary questions was established by content validity analysis. Compliance with the app, assessed during feasibility testing, was high (mean 81%, SD 22%) and adolescents from this phase of the study found the app likeable, easy to use, and not bothersome to complete. A multifaceted usability approach demonstrated how the Pain Squad app could be made more appealing to children and adolescents with cancer. The game-based nature and built-in reward system of the app was appealing to adolescents and may have resulted in the high compliance rates and satisfaction ratings observed during clinical feasibility testing.
NASA Astrophysics Data System (ADS)
Supper, R.; Baroň, I.; Ottowitz, D.; Motschka, K.; Gruber, S.; Winkler, E.; Jochum, B.; Römer, A.
2013-05-01
In September 2009, a complex airborne geophysical survey was performed in the large landslide affected area of the Gschliefgraben valley, Upper Austria, in order to evaluate the usability of this method for landslide detection and mapping. An evaluation of the results, including different remote sensing and ground based methods, proved that airborne geophysics, especially the airborne electromagnetic method, has a high potential for landslide investigation. This is due to its sensitivity to fluid and clay content and porosity, which are parameters showing characteristic values in landslide prone structures. Resistivity distributions in different depth levels as well as depth-slices along selected profiles are presented and compared with ground geoelectrical profiles for the test area of Gschliefgraben. Further interesting results can be derived from the radiometric survey, whereas the naturally occurring radioisotopes 40K and 232Th, as well as the man-made nuclide 137Cs have been considered. While the content of potassium and thorium in the shallow subsurface layer is expressively related to the lithological composition, the distribution of caesium is mainly determined by mass wasting processes.
A wireless PDA-based physiological monitoring system for patient transport.
Lin, Yuan-Hsiang; Jan, I-Chien; Ko, Patrick Chow-In; Chen, Yen-Yu; Wong, Jau-Min; Jan, Gwo-Jen
2004-12-01
This paper proposes a mobile patient monitoring system, which integrates current personal digital assistant (PDA) technology and wireless local area network (WLAN) technology. At the patient's location, a wireless PDA-based monitor is used to acquire continuously the patient's vital signs, including heart rate, three-lead electrocardiography, and SpO2. Through the WLAN, the patient's biosignals can be transmitted in real-time to a remote central management unit, and authorized medical staffs can access the data and the case history of the patient, either by the central management unit or the wireless devices. A prototype of this system has been developed and implemented. The system has been evaluated by technical verification, clinical test, and user survey. The evaluation of performance yields a high degree of satisfaction (mean = 4.64, standard deviation--SD = 0.53 in a five-point Likert scale) of users who used the PDA-based system for intrahospital transport. The results also show that the wireless PDA model is superior to the currently used monitors both in mobility and in usability, and is, therefore, better suited to patient transport.
Attitudes and norms affecting scientists’ data reuse
Curty, Renata Gonçalves; Specht, Alison; Grant, Bruce W.; Dalton, Elizabeth D.
2017-01-01
The value of sharing scientific research data is widely appreciated, but factors that hinder or prompt the reuse of data remain poorly understood. Using the Theory of Reasoned Action, we test the relationship between the beliefs and attitudes of scientists towards data reuse, and their self-reported data reuse behaviour. To do so, we used existing responses to selected questions from a worldwide survey of scientists developed and administered by the DataONE Usability and Assessment Working Group (thus practicing data reuse ourselves). Results show that the perceived efficacy and efficiency of data reuse are strong predictors of reuse behaviour, and that the perceived importance of data reuse corresponds to greater reuse. Expressed lack of trust in existing data and perceived norms against data reuse were not found to be major impediments for reuse contrary to our expectations. We found that reported use of models and remotely-sensed data was associated with greater reuse. The results suggest that data reuse would be encouraged and normalized by demonstration of its value. We offer some theoretical and practical suggestions that could help to legitimize investment and policies in favor of data sharing. PMID:29281658
Almenara, Maria; Cempini, Marco; Gómez, Cristina; Cortese, Mario; Martín, Cristina; Medina, Josep; Vitiello, Nicola; Opisso, Eloy
2017-01-01
(1) To assess a robotic device (Handexos) during the design process with regard to usability, end user satisfaction and safety, (2) to determine whether Handexos can improve the activities of daily living (ADLs) of spinal cord injury (SCI) patients and stroke patients with upper-limb dysfunction. During a 2-year development stage of the device, a total of 37 participants (aged 22-68), 28 clinicians (experts) and nine patients with SCI or stroke (end users) were included in a user-centered design process featuring usability tests. They performed five grasps wearing the device. The assessments were obtained at the end of the session by filling out a questionnaire and making suggestions. The experts' opinion was that the modified device was an improvement over the preliminary version, although this was not reflected in the scores. Whereas end user scores for comfort, grasp, performance and safety were above the sufficiency threshold, the scores for year 2 were lower than those for year 1. The findings demonstrate that although Handexos meets the initial functional requirements and underlines the potential for assisting SCI and post-stroke subjects in ADLs, several aspects such as mechanical complexity and low adaptability to different hand sizes need to be further addressed. Implications for Rehabilitation Wearable robotics devices could improve the activities of daily living in patients with spinal cord injury or stroke. They could be a tool for rehabilitation of the upper limb. Further usability tests to improve this type of tools are recommended.
Chaney, Beth; Chaney, Don; Paige, Samantha; Payne-Purvis, Caroline; Tennant, Bethany; Walsh-Childers, Kim; Sriram, PS; Alber, Julia
2015-01-01
Background Patients with chronic obstructive pulmonary disease (COPD) often report inadequate access to comprehensive patient education resources. Objective The purpose of this study was to incorporate community-engagement principles within a mixed-method research design to evaluate the usability and acceptability of a self-tailored social media resource center for medically underserved patients with COPD. Methods A multiphase sequential design (qual → QUANT → quant + QUAL) was incorporated into the current study, whereby a small-scale qualitative (qual) study informed the design of a social media website prototype that was tested with patients during a computer-based usability study (QUANT). To identify usability violations and determine whether or not patients found the website prototype acceptable for use, each patient was asked to complete an 18-item website usability and acceptability questionnaire, as well as a retrospective, in-depth, semistructured interview (quant + QUAL). Results The majority of medically underserved patients with COPD (n=8, mean 56 years, SD 7) found the social media website prototype to be easy to navigate and relevant to their self-management information needs. Mean responses on the 18-item website usability and acceptability questionnaire were very high on a scale of 1 (strongly disagree) to 5 (strongly agree) (mean 4.72, SD 0.33). However, the majority of patients identified several usability violations related to the prototype’s information design, interactive capabilities, and navigational structure. Specifically, 6 out of 8 (75%) patients struggled to create a log-in account to access the prototype, and 7 out of 8 patients (88%) experienced difficulty posting and replying to comments on an interactive discussion forum. Conclusions Patient perceptions of most social media website prototype features (eg, clickable picture-based screenshots of videos, comment tools) were largely positive. Mixed-method stakeholder feedback was used to make design recommendations, categorize usability violations, and prioritize potential solutions for improving the usability of a social media resource center for COPD patient education. PMID:25630449
Eucapnic voluntary hyperventilation in diagnosing exercise-induced laryngeal obstructions.
Christensen, Pernille M; Rasmussen, Niels
2013-11-01
Exercise-induced laryngeal obstructions (EILOs) cause exercise-related respiratory symptoms (ERRS) and are important differential diagnoses to exercise-induced asthma. The diagnostic method for EILOs includes provocation to induce the obstruction followed by a verification of the obstruction and the degree thereof. The objective of the present study was to examine if a eucapnic voluntary hyperventilation (EVH) test could induce laryngeal obstructions laryngoscopically identical in subtypes and development as seen during an exercise test. EVH and exercise testing with continuous laryngoscopy were performed during a screening of two national athletic teams (n = 67). The laryngoscopic recordings were examined for usability, abnormalities and maximal supraglottic and glottic obstruction using two currently available methods (Eilomea and CLE-score). The participants were asked questions on ERRS, and whether the symptoms experienced during each provocation matched those experienced during regular training. A total of 39 completed both tests. There were no significant differences in subtypes and development thereof, the experience of symptoms, and specificity and sensitivity between the methods. Significantly more recordings obtained during the exercise test were usable for evaluation primarily due to resilient mucus on the tip of the fiber-laryngoscope in the EVH test. Only recordings of six athletes from both provocation methods were usable for evaluation using the Eilomea method (high-quality demand). Amongst these, a linear correlation was found for the glottic obstruction. EVH tests can induce EILOs. However, the present test protocol needs adjustments to secure better visualisation of the larynx during provocation.
The Superorbital Expansion Tube concept, experiment and analysis
NASA Technical Reports Server (NTRS)
Neely, A. J.; Morgan, R. G.
1995-01-01
In response to the need for ground testing facilities for super orbital re-entry research, a small scale facility has been set up at the University of Queensland to demonstrate the superorbital expansion tube concept. This unique device is a free piston driven, triple diaphragm, impulse shock facility which uses the enthalpy multiplication mechanism of the unsteady expansion process and the addition of a secondary shock driver to further heat the driver gas. The pilot facility has been operated to produce quasi-steady test flows in air with shock velocities in excess of 13 km/s and with a usable test flow duration of the order of 15 micro sec. an experimental condition produced in the facility with total enthalpy of 108 MJ/kg and a total pressure of 335 MPa is reported. A simple analytical flow model which accounts for non-ideal rupture of the light tertiary diaphragm and the resulting entropy increase in the test gas is discussed. It is shown that equilibrium calculations more accurately model the unsteady expansion process than calculations assuming frozen chemistry. This is because the high enthalpy flows produced in the facility can only be achieved if the chemical energy stored in the test flow during shock heating of the test gas is partially returned to the flow during the process of unsteady expansion. Measurements of heat transfer rates to a flat plate demonstrate the usability of test flow for aerothermodynamic testing and comparison of these rates with empirical calculations confirms the usable accuracy of the flow model.
Development of an interactive social media tool for parents with concerns about vaccines.
Shoup, Jo Ann; Wagner, Nicole M; Kraus, Courtney R; Narwaney, Komal J; Goddard, Kristin S; Glanz, Jason M
2015-06-01
Describe a process for designing, building, and evaluating a theory-driven social media intervention tool to help reduce parental concerns about vaccination. We developed an interactive web-based tool using quantitative and qualitative methods (e.g., survey, focus groups, individual interviews, and usability testing). Survey results suggested that social media may represent an effective intervention tool to help parents make informed decisions about vaccination for their children. Focus groups and interviews revealed four main themes for development of the tool: Parents wanted information describing both benefits and risks of vaccination, transparency of sources of information, moderation of the tool by an expert, and ethnic and racial diversity in the visual display of people. Usability testing showed that parents were satisfied with the usability of the tool but had difficulty with performing some of the informational searches. Based on focus groups, interviews, and usability evaluations, we made additional revisions to the tool's content, design, functionality, and overall look and feel. Engaging parents at all stages of development is critical when designing a tool to address concerns about childhood vaccines. Although this can be both resource- and time-intensive, the redesigned tool is more likely to be accepted and used by parents. Next steps involve a formal evaluation through a randomized trial. © 2014 Society for Public Health Education.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Stumpf, R.P.; Frayer, M.L.
1997-06-01
Florida Bay, at the southern tip of Florida, USA, has undergone dramatic changes in recent years. Following seagrass dieoffs starting in the late 1980`s, both algal blooms and high turbidity (the latter from resuspended sediments) have been reported as more common in the Bay. Remotely sensed data, particularly from the AVHRR (advanced very high resolution radiometer), can provide information on conditions prior to the start of monitoring programs as well as provide additional spatial detail on water clarity and particulate loads in this estuary . The AVHRR record currently available to us consists of over 600 usable scenes from December,more » 1989. Comparisons with field data have provided relationships with light attenuation, total suspended solids, and other turbidity measures. The imagery shows the seasonal change in turbidity resulting from high winds associated with winter cold fronts. Over the seven-year record, areas of clear water have decreased in the north-central Bay, while expanding in the southwestern Bay.« less
A pen-based system to support pre-operative data collection within an anaesthesia department.
Sanz, M. F.; Gómez, E. J.; Trueba, I.; Cano, P.; Arredondo, M. T.; del Pozo, F.
1993-01-01
This paper describes the design and implementation of a pen-based computer system for remote preoperative data collection. The system is envisaged to be used by anaesthesia staff at different hospital scenarios where pre-operative data are generated. Pen-based technology offers important advantages in terms of portability and human-computer interaction, as direct manipulation interfaces by direct pointing, and "notebook user interfaces metaphors". Being the human factors analysis and user interface design a vital stage to achieve the appropriate user acceptability, a methodology that integrates the "usability" evaluation from the earlier development stages was used. Additionally, the selection of a pen-based computer system as a portable device to be used by health care personnel allows to evaluate the appropriateness of this new technology for remote data collection within the hospital environment. The work presented is currently being realised under the Research Project "TANIT: Telematics in Anaesthesia and Intensive Care", within the "A.I.M.--Telematics in Health CARE" European Research Program. PMID:8130488
Grim, Katarina; Rosenberg, David; Svedberg, Petra; Schön, Ulla-Karin
2017-09-01
Shared decision making (SMD) related to treatment and rehabilitation is considered a central component in recovery-oriented practice. Although decision aids are regarded as an essential component for successfully implementing SDM, these aids are often lacking within psychiatric services. The aim of this study was to use a participatory design to facilitate the development of a user-generated, web-based decision aid for individuals receiving psychiatric services. The results of this effort as well as the lessons learned during the development and usability processes are reported. The participatory design included 4 iterative cycles of development. Various qualitative methods for data collection were used with potential end users participating as informants in focus group and individual interviews and as usability and pilot testers. Interviewing and testing identified usability problems that then led to refinements and making the subsequent prototypes increasingly user-friendly and relevant. In each phase of the process, feedback from potential end-users provided guidance in developing the formation of the web-based decision aid that strengthens the position of users by integrating access to information regarding alternative supports, interactivity between staff and users, and user preferences as a continual focus in the tool. This web-based decision aid has the potential to strengthen service users' experience of self-efficacy and control as well as provide staff access to user knowledge and preferences. Studies employing participatory models focusing on usability have potential to significantly contribute to the development and implementation of tools that reflect user perspectives. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Pei, Yu-Cheng; Chen, Jean-Lon; Wong, Alice M K; Tseng, Kevin C
2017-01-01
Case series. IV (case series). Robot-assisted therapy for upper limb rehabilitation is an emerging research topic and its design process must integrate engineering, neurological pathophysiology, and clinical needs. This study developed/evaluated the usefulness of a novel rehabilitation device, the MirrorPath , designed for the upper limb rehabilitation of patients with hemiplegic stroke. The process follows Tseng's methodology for innovative product design and development, namely two stages, device development and usability assessment. During the development process, the design was guided by patients' rehabilitation needs as defined by patients and their therapists. The design applied synchronic movement of the bilateral upper limbs, an approach that is compatible with the bilateral movement therapy and proprioceptive neuromuscular facilitation theories. MirrorPath consists of a robotic device that guides upper limb movement linked to a control module containing software controlling the robotic movement. Five healthy subjects were recruited in the pretest, and 4 patients, 4 caregivers, and 4 therapists were recruited in the formal test for usability. All recruited subjects were allocated to the test group, completed the evaluation, and their data were all analyzed. The total system usability scale score obtained from the patients, caregivers, and therapists was 71.8 ± 11.9, indicating a high level of usability and product acceptance. Following a standard development process, we could yield a design that meets clinical needs. This low-cost device provides a feasible platform for carrying out robot-assisted bilateral movement therapy of patients with hemiplegic stroke. identifier NCT02698605.
Nikus, Kjell; Lähteenmäki, Jaakko; Lehto, Pasi; Eskola, Markku
2009-01-01
Today's coronary care unit patients include those with complicated and uncomplicated myocardial infarction, decompensated heart failure and frank cardiogenic shock, severe valvular heart disease, high-grade conduction disturbances, and incessant ventricular arrhythmias. Increasingly in modern medicine, these conditions are not seen in isolation but rather in connection with a series of additional medical comorbidities. Increased life expectancy results in an increase in the prevalence of chronic cardiovascular diseases and an increased demand for health care services. Telemedicine is the provision of health care services, through the use of information and communication technology, in situations where the health care professional and the patient, or 2 health care professionals, are not in the same location. It involves the secure transmission of medical data and information, through text, sound, images, or other forms needed for the prevention, diagnosis, treatment, and follow-up of a patient. Telecardiology is one of the oldest applications in telemedicine and has been largely applied during the last 10 to 20 years. This study evaluated the feasibility of remote surveillance of coronary care unit and cardiology ward patient monitoring data by a "telecardiologist" with access to electronic health care record data and digitally stored 12-lead electrocardiograms. The remote access to the hospital intranet proved to be technically feasible. Also, the server applications used over the remote connection proved to be reliable and showed robustness against network performance variations. Extending remote patient surveillance to other hospitals is possible, provided that similar electrocardiogram and electronic health care record applications are available and a remote access can be arranged to them. However, the usability from cardiologist's perspective may be degraded if connecting with multiple applications and hospital networks is needed. The study indicated potential for speeding up the diagnostic and therapeutic processes in the hospital, although the study was limited in that the telecardiologist played a passive role and did not acutely impact patient care. In the future, the system could be expanded to surveillance of smaller hospitals. Telemedicine has the potential to aid in solving the conflict between aging of population, rise in the demand for critical care services, and shortage of professional personnel. This might, however, require a more active remote surveillance than the one tested in this study. Privacy- and security-related aspects are major components of building trust and confidence in telemedicine systems. In telecardiology, the real-time interactive telemedicine model with 24/7 service has potential superior performance compared with a store-and-forward telemedicine model.
Facilitating Secure Sharing of Personal Health Data in the Cloud.
Thilakanathan, Danan; Calvo, Rafael A; Chen, Shiping; Nepal, Surya; Glozier, Nick
2016-05-27
Internet-based applications are providing new ways of promoting health and reducing the cost of care. Although data can be kept encrypted in servers, the user does not have the ability to decide whom the data are shared with. Technically this is linked to the problem of who owns the data encryption keys required to decrypt the data. Currently, cloud service providers, rather than users, have full rights to the key. In practical terms this makes the users lose full control over their data. Trust and uptake of these applications can be increased by allowing patients to feel in control of their data, generally stored in cloud-based services. This paper addresses this security challenge by providing the user a way of controlling encryption keys independently of the cloud service provider. We provide a secure and usable system that enables a patient to share health information with doctors and specialists. We contribute a secure protocol for patients to share their data with doctors and others on the cloud while keeping complete ownership. We developed a simple, stereotypical health application and carried out security tests, performance tests, and usability tests with both students and doctors (N=15). We developed the health application as an app for Android mobile phones. We carried out the usability tests on potential participants and medical professionals. Of 20 participants, 14 (70%) either agreed or strongly agreed that they felt safer using our system. Using mixed methods, we show that participants agreed that privacy and security of health data are important and that our system addresses these issues. We presented a security protocol that enables patients to securely share their eHealth data with doctors and nurses and developed a secure and usable system that enables patients to share mental health information with doctors.
Ybarra, Michele; Biringi, Ruth; Prescott, Tonya; Bull, Sheana S.
2012-01-01
Use of Internet is growing in Sub Saharan Africa. Evidence of computer and Internet effectiveness for reduction in risk behaviors associated with HIV shown in U.S. settings has yet to be replicated in Africa. We describe the development, usability and navigability testing of an Internet-based HIV prevention program for secondary school students in Uganda, called CyberSenga. For this work, we used four data collection activities, including observation of (a) computer skills and (b) navigation, (c) focus group discussions, and (d) field assessments to document comprehension and usability of program content. We document limited skills among students, but youth with basic computers skills were able to navigate the program after instruction. Youth were most interested in activities with more interaction. Field-testing illustrated the importance of using a stand-alone electrical source during program delivery. This work suggests delivery of Internet-based health promotion content in Africa requires attention to user preparedness and literacy, bandwidth, Internet connection, and electricity. PMID:22918136
Peffer, Therese; Perry, Daniel; Pritoni, Marco; Aragon, Cecilia; Meier, Alan
2013-01-01
Thermostats control heating and cooling in homes - representing a major part of domestic energy use - yet, poor ergonomics of these devices has thwarted efforts to reduce energy consumption. Theoretically, programmable thermostats can reduce energy by 5-15%, but in practice little to no savings compared to manual thermostats are found. Several studies have found that programmable thermostats are not installed properly, are generally misunderstood and have poor usability. After conducting a usability study of programmable thermostats, we reviewed several guidelines from ergonomics, general device usability, computer-human interfaces and building control sources. We analysed the characteristics of thermostats that enabled or hindered successfully completing tasks and in a timely manner. Subjects had higher success rates with thermostat displays with positive examples of guidelines, such as visibility of possible actions, consistency and standards, and feedback. We suggested other guidelines that seemed missing, such as navigation cues, clear hierarchy and simple decision paths. Our evaluation of a usability test of five residential programmable thermostats led to the development of a comprehensive set of specific guidelines for thermostat design including visibility of possible actions, consistency, standards, simple decision paths and clear hierarchy. Improving the usability of thermostats may facilitate energy savings.
Deems-Dluhy, Susan L; Jayaraman, Chandrasekaran; Green, Steve; Albert, Mark V; Jayaraman, Arun
2017-05-01
Difficulty ascending ramps and inclines with a manual wheelchair adversely affects the everyday mobility and overall quality of life of manual wheelchair users. Currently, various anti-rollback devices are available to assist manual wheelchair users to ascend ramps and inclines. However, these devices have 2 main shortcomings: restriction to backward motion limiting recovery from an overturning wheelchair, which is a safety concern; and difficulty in engaging/disengaging the device while on the ramp. To evaluate the functionality and usability of 2 novel wheelchair anti-rollback devices developed to address these shortcomings (prototypes "Wheel" and "Brake"). Cross-sectional. Rehabilitation research facility. Twelve adult participants with chronic spinal cord injury. Participants completed training and tested with both the wheelchair anti-rollback devices on a 7.3-m-long ramp. Number of stops, perceived physical exertion, pain, and ease of use of these devices as participants maneuvered their wheelchairs up a 7.3-m ramp were assessed. Participants also evaluated their satisfaction with the usability of both the devices using the Quebec User Evaluation of Satisfaction With Assistive Technology (QUEST 2.0). Both prototypes evaluated overcame the limitations of the existing anti-rollback devices. Nonparametric statistical tests showed that participants rated both prototypes similarly for the overall functional and usability aspects. However, the participants' satisfactory rating were higher for the prototype "Brake" than for the prototype "Wheel" based on a functional aspect (ie, engaging/disengaging easiness), and higher for Wheel than for Brake, based on a usability aspect (prototype size). The qualitative and quantitative outcomes of this investigation, based on the usability and functional evaluations, provided useful information for the improvement in the design of both anti-rollback devices, which may allow manual wheelchair users to manage ramp ascent more safely and easily. Further evaluations with a different SCI population is recommended. IV. Copyright © 2017 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.
2013-01-01
Background Although numerous evidence-based and feasible interventions are available to treat pain from childhood vaccine injections, evidence indicates that children are not benefitting from this knowledge. Unrelieved vaccination pain puts children at risk for significant long-term harms including the development of needle fears and subsequent health care avoidance behaviours. Parents report that while they want to mitigate vaccination pain in their children, they lack knowledge about how to do so. An evidence-based clinical practice guideline for managing vaccination pain was recently developed in order to address this knowledge-to-care gap. Educational tools (pamphlet and video) for parents were included to facilitate knowledge transfer at the point of care. The objectives of this study were to evaluate usability and effectiveness in terms of knowledge acquisition from the pamphlet and video in parents of newly born infants. Methods Mixed methods design. Following heuristic usability evaluation of the pamphlet and video, parents of newborn infants reviewed revised versions of both tools and participated in individual and group interviews and individual knowledge testing. The knowledge test comprised of 10 true/false questions about the effectiveness of various pain management interventions, and was administered at three time points: at baseline, after review of the pamphlet, and after review of the video. Results Three overarching themes were identified from the interviews regarding usability of these educational tools: receptivity to learning, accessibility to information, and validity of information. Parents’ performance on the knowledge test improved (p≤0.001) from the baseline phase to after review of the pamphlet, and again from the pamphlet review phase to after review of the video. Conclusions Using a robust testing process, we demonstrated usability and conceptual knowledge acquisition from a parent-directed educational pamphlet and video about management of vaccination pain. Future studies are planned to determine the impact of these educational tools when introduced in clinical settings on parent behaviors during infant vaccinations. PMID:23394070
NASA Technical Reports Server (NTRS)
Eigen, D. J.; Fromm, F. R.; Northouse, R. A.
1974-01-01
A new clustering algorithm is presented that is based on dimensional information. The algorithm includes an inherent feature selection criterion, which is discussed. Further, a heuristic method for choosing the proper number of intervals for a frequency distribution histogram, a feature necessary for the algorithm, is presented. The algorithm, although usable as a stand-alone clustering technique, is then utilized as a global approximator. Local clustering techniques and configuration of a global-local scheme are discussed, and finally the complete global-local and feature selector configuration is shown in application to a real-time adaptive classification scheme for the analysis of remote sensed multispectral scanner data.
Satellite-based products for forest fire prevention and recovery: the PREFER experience
NASA Astrophysics Data System (ADS)
Laneve, Giovanni; Bernini, Guido; Fusilli, Lorenzo; Marzialetti, Pablo
2016-08-01
PREFER is a three years projects funded in 2012 in the framework of the FP7 Emergency call. The project objective was to set up a space-based service infrastructure and up-to-date cartographic products, based on remote sensing data, to support the preparedness, prevention, recovery and reconstruction phases of the Forest Fires emergency cycle in the European Mediterranean Region. The products of PREFER were tested and evaluated during the training and the demonstration period of the project, which coincided with the forest fire season of 2015. The products were tested using the online PREFER service and the tests were linked to the pilot areas of the project which are Minho (Portugal), Messenia (Greece), Andalucía (Spain), Sardinia (Italy) and Corse (France). Testing was performed by members of the User Advisory Board (UAB) starting from the training event organized in Coimbra, Portugal in June 2015. The tests continued till the end of the fire season (October 2015) and the end users were provided with updated information for the areas of interest during the entire demonstration period. Due to data availability restrictions (in particular to ancillary required data) not all products were available for testing in all the test areas. However all the PREFER products were tested at least in one pilot area and in cooperation with at least one end user organization. It has to be mentioned that beyond the product suitability and usefulness to the end users the tests included evaluation of the usability of the web-based service of PREFER and the respective quality of service provided. This paper aims at presenting the results of the demonstration activity, the lessons learned and ideas for further enhancement of the developed products devoted to support prevention and recovery phases of the wildfire cycle.
Horton, Emily L; Renganathan, Ramkesh; Toth, Bryan N; Cohen, Alexa J; Bajcsy, Andrea V; Bateman, Amelia; Jennings, Mathew C; Khattar, Anish; Kuo, Ryan S; Lee, Felix A; Lim, Meilin K; Migasiuk, Laura W; Zhang, Amy; Zhao, Oliver K; Oliveira, Marcio A
2017-01-01
To lay the groundwork for devising, improving, and implementing new technologies to meet the needs of individuals with visual impairments, a systematic literature review was conducted to: a) describe hardware platforms used in assistive devices, b) identify their various applications, and c) summarize practices in user testing conducted with these devices. A search in relevant EBSCO databases for articles published between 1980 and 2014 with terminology related to visual impairment, technology, and tactile sensory adaptation yielded 62 articles that met the inclusion criteria for final review. It was found that while earlier hardware development focused on pin matrices, the emphasis then shifted toward force feedback haptics and accessible touch screens. The inclusion of interactive and multimodal features has become increasingly prevalent. The quantity and consistency of research on navigation, education, and computer accessibility suggest that these are pertinent areas of need for the visually impaired community. Methodologies for usability testing ranged from case studies to larger cross-sectional studies. Many studies used blindfolded sighted users to draw conclusions about design principles and usability. Altogether, the findings presented in this review provide insight on effective design strategies and user testing methodologies for future research on assistive technology for individuals with visual impairments.
Jeffs, Lauren; Wycherley, Thomas Philip; Maher, Carol; Smith, Ross; Hart, Jonathon; Cubillo, Beau; Brimblecombe, Julie
2017-01-01
Background The disproportionate burden of noncommunicable disease among Indigenous Australians living in remote Indigenous communities (RICs) is a complex and persistent problem. Smartphones are increasingly being used by young Indigenous adults and therefore represent a promising method to engage them in programs seeking to improve nutritional intake. Objective This study aimed to consult RIC members to inform the content of a smartphone app that can be used to monitor and reduce sugar-sweetened beverage intake in RICs. Methods The study was conducted in two phases. The formative phase involved a simulated grocery selection activity with think aloud (“think aloud shop”), a semistructured interview, a questionnaire outlining current smartphone and app use, and a paper prototyping activity. A preliminary end-user testing phase involved a think aloud prototype test and a semistructured interview regarding user satisfaction. Convenience sampling was used to recruit 20 18- to 35-year-old smartphone users for each phase from two RICs in the Northern Territory, Australia. Thematic analysis of transcribed audio recordings was used to identify determinants of food choice from the think aloud shop; themes related to the Theory of Planned Behavior (TPB) from the eating behaviors interview; and usability, comprehension, and satisfaction with the app from the preliminary end-user testing. Results Smartphone use in RICs is currently different to that found in urban environments; in particular, extremely low use of Facebook, restricted variety of phone types, and limited Internet access. Findings regarding promoting app engagement indicate that utilizing an opt-in approach to social features such as leader boards and team challenges is essential. The inclusion of games was also shown to be important for satisfaction, as were the use of audio features, contextually embedded dissemination, and streamlined app design for comprehension in this target group. Conclusions This research provides critical insights and concrete recommendations for the development of lifestyle improvement apps targeted toward disadvantaged young adults in nonurban settings, specifically RICs. It serves as a framework for future app development projects using a consultative user-centered design approach, supporting calls for the increased use of this strategy in app development. PMID:29233803
Reumkens, Kelly; Tummers, Marly H E; Gietel-Habets, Joyce J G; van Kuijk, Sander M J; Aalfs, Cora M; van Asperen, Christi J; Ausems, Margreet G E M; Collée, Margriet; Dommering, Charlotte J; Kets, C Marleen; van der Kolk, Lizet E; Oosterwijk, Jan C; Tjan-Heijnen, Vivianne C G; van der Weijden, Trudy; de Die-Smulders, Christine E M; van Osch, Liesbeth A D M
2018-05-30
An online decision aid to support persons having a genetic predisposition to cancer and their partners during reproductive decision-making was developed. A two-phase usability test was conducted among 12 couples (N = 22; 2 persons participated without their partner) at risk for hereditary cancer and 15 health care providers. Couples and health care providers expressed similar suggestions for improvements, and evaluated the modified decision aid as acceptable, easy to use, and comprehensible. The final decision aid was pilot tested (N = 16) with paired sample t tests comparing main outcomes (decisional conflict, knowledge, realistic expectations regarding the reproductive options and decision self-efficacy) before (T0), immediately (T1) and 2 weeks after (T2) use of the decision aid. Pilot testing indicated decreased decisional conflict scores, increased knowledge, and improved realistic expectations regarding the reproductive options, at T1 and T2. No effect was found for couples' decision self-efficacy. The positive findings during usability testing were thus reflected in the pilot study. The decision aid will be further evaluated in a nationwide pretest-posttest study to facilitate implementation in the onco-genetic counselling setting. Ultimately, it is expected that the decision aid will enable end-users to make an informed decision.
Knight, Lucia; Makusha, Tawanda; Lim, Jeanette; Peck, Roger; Taegtmeyer, Miriam; van Rooyen, Heidi
2017-09-18
The uptake of HIV testing has increased in sub-Saharan Africa over the past three decades. However, the proportion of people aware of their HIV status remains lower than required to change the pandemic. HIV self-testing (HIVST) may meet this gap. Assessment of readiness for and the acceptability of HIVST by lay users in South Africa is limited. This paper presents results from a formative study designed to assess the perceived usability and acceptability of HIVST among lay users using several self-test prototypes. Fifty lay users were purposively selected from rural and peri-urban KwaZulu-Natal, South Africa. Acceptability of HIVST was assessed using a simple post-test quantitative assessment tool addressing confidence, ease-of-use, intended future use and willingness to pay. In-depth qualitative interviews explored what participants felt about the HIVST and why, their willingness to recommend and how much they would pay for a test. The key finding is that there is high acceptability regardless of self-test prototype. Acceptability is framed by two domains: usability and perceived need. Perceived usability was explored through perceived ease of use, which, regardless of actual correct usage, was reported by many of the respondents. Acceptability is influenced by perceived need, expressed by many who felt that the need for the self-test to protect privacy and autonomy. Ease of access and widespread availability of the test, not at a significant cost, were also important factors. Many participants would recommend self-test use to others and also indicated that they would choose to conduct the test again if it was free while some also indicated being willing to buy a test. The positive response and readiness amongst lay users for an HIVST in this context prototype suggests that there would be a ready and willing market for HIVST. For scalability and sustainability usability, including access and availability that are here independent indications of acceptability, should be considered. So too should the desire for future use, as an additional factor pointing to acceptability. The results show high acceptability in all of these areas domains and a general interest in HIVST amongst lay users in a community in KwaZulu-Natal.
McClellan, Molly A; Karumur, Raghav Pavan; Vogel, Rachel Isaksson; Petzel, Sue V; Cragg, Julie; Chan, Daniel; Jacko, Julie A; Sainfort, François; Geller, Melissa A
A broad-based research team developed a Health Insurance Portability and Accountability Act (HIPAA)-compliant educational website for women with ovarian cancer to improve the quality of supportive oncology care. Prior to a randomized clinical trial of the website, initial usability testing was implemented to evaluate the website. The initial review found that 165/247 checklist items had sufficient information to allow for evaluation with the website achieving an overall score of 63%. By category, lowest scores were for the Home Page, Task Orientation, Page Layout & Visual Design, and Help, Feedback & Error Tolerance. Major issues thought to potentially impede actual usage were prioritized in redevelopment and the second usability review, conducted by the same expert, saw an improvement in scores. Incorporating usability concepts from the start of development, fulfilling the positive expectations of end-users and identifying technical and personal factors that optimize use may greatly enhance usage of health websites.
McClellan, Molly A.; Karumur, Raghav Pavan; Vogel, Rachel Isaksson; Petzel, Sue V.; Cragg, Julie; Chan, Daniel; Jacko, Julie A.; Sainfort, François; Geller, Melissa A.
2016-01-01
A broad-based research team developed a Health Insurance Portability and Accountability Act (HIPAA)-compliant educational website for women with ovarian cancer to improve the quality of supportive oncology care. Prior to a randomized clinical trial of the website, initial usability testing was implemented to evaluate the website. The initial review found that 165/247 checklist items had sufficient information to allow for evaluation with the website achieving an overall score of 63%. By category, lowest scores were for the Home Page, Task Orientation, Page Layout & Visual Design, and Help, Feedback & Error Tolerance. Major issues thought to potentially impede actual usage were prioritized in redevelopment and the second usability review, conducted by the same expert, saw an improvement in scores. Incorporating usability concepts from the start of development, fulfilling the positive expectations of end-users and identifying technical and personal factors that optimize use may greatly enhance usage of health websites. PMID:27110082
Virtual gaming simulation of a mental health assessment: A usability study.
Verkuyl, Margaret; Romaniuk, Daria; Mastrilli, Paula
2018-05-18
Providing safe and realistic virtual simulations could be an effective way to facilitate the transition from the classroom to clinical practice. As nursing programs begin to include virtual simulations as a learning strategy; it is critical to first assess the technology for ease of use and usefulness. A virtual gaming simulation was developed, and a usability study was conducted to assess its ease of use and usefulness for students and faculty. The Technology Acceptance Model provided the framework for the study, which included expert review and testing by nursing faculty and nursing students. This study highlighted the importance of assessing ease of use and usefulness in a virtual game simulation and provided feedback for the development of an effective virtual gaming simulation. The study participants said the virtual gaming simulation was engaging, realistic and similar to a clinical experience. Participants found the game easy to use and useful. Testing provided the development team with ideas to improve the user interface. The usability methodology provided is a replicable approach to testing virtual experiences before a research study or before implementing virtual experiences into curriculum. Copyright © 2018 Elsevier Ltd. All rights reserved.
NASA Johnson Space Center Usability Testing and Analysis facility (UTAF) Overview
NASA Technical Reports Server (NTRS)
Whitmore, Mihriban; Holden, Kritina L.
2005-01-01
The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility performs research for NASA's HumanSystems Integration Program, under the HumanSystems Research and Technology Division. Specifically, the UTAF provides human factors support for space vehicles, including the International Space Station, the Space Shuttle, and the forthcoming Crew Exploration Vehicle. In addition, there are ongoing collaborative research efforts with external corporations and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes and requirements. This presentation will provide an overview of ongoing activities, and will address how the UTAF projects will evolve to meet new space initiatives.
Cousineau, Tara M; Lord, Sarah E; Seibring, Angel R; Corsini, Evelyn A; Viders, Jessie C; Lakhani, Shaheen R
2004-03-01
To develop and test the feasibility of a theory-driven, psychosocial support CD-ROM prototype for couples in infertility treatment. Focus group meetings with reproductive health experts, semistructured interviews with infertility patients, and content analysis of an infertility message board to determine content domains of the CD-ROM. Usability and acceptance testing of prototype CD-ROM based on predetermined feasibility criteria. Private offices and fertility centers. Expert panel of 5 reproductive health specialists; interviews with 62 individuals with infertility (35 women, 27 men); feasibility study with 12 patients and 12 experts in reproductive medicine and infertility support. None. Product usability/acceptance test. Participant feedback and content analysis informed the development of a prototype patient education CD-ROM that uses audio, video, interactive tasks, and personalized feedback. Over 80% of participants successfully completed usability tasks, and over 90% rated prototype satisfaction as "good" to "excellent." Some areas were noted for improvement in navigation and refinement in delivery of instructions. Results strongly indicate an interest in an infertility multimedia support tool. Multimedia methods may serve as an effective, innovative psychosocial intervention for infertility patients and overcome barriers of limited local access to educational and support services.
Usability issues concerning child restraint system harness design.
Rudin-Brown, Christina M; Kumagai, Jason K; Angel, Harry A; Iwasa-Madge, Kim M; Noy, Y Ian
2003-05-01
A study was conducted to assess usability issues relating to child restraint system (CRS) harness design. Four convertible child restraint systems representing a wide variety of design features were used. Forty-two participants installed two child test dummies in both forward- and rear-facing configurations either inside or outside a test vehicle. Observer-scored checklists determined the degree to which each harness was installed correctly. Participant-scored questionnaires evaluated the 'ease-of-use' of various design features. While the percentage of correct installations exceeded 83% for all designs when installed in the forward-facing configuration, in the rear-facing position (that intended for children under 9-10 kg), there was a significant (between 65 and 89%) percentage of incorrect installations for all models. This finding is of particular interest and may be indicative of a more generalized problem with 'convertible' CRS designs when they are used in the rear-facing configuration. Furthermore, while certain design features were perceived by users as providing significantly better protection in the event of a collision, these also tended to be the features that were misused most often. The benefits and costs of various design features are discussed, and a method to test harness design usability is presented.
Forensic botany: usability of bryophyte material in forensic studies.
Virtanen, Viivi; Korpelainen, Helena; Kostamo, Kirsi
2007-10-25
Two experiments were performed to test the relevance of bryophyte (Plantae, Bryophyta) material for forensic studies. The first experiment was conducted to reveal if, and how well, plant fragments attach to footwear in general. In the test, 16 persons walked outdoors wearing rubber boots or hiking boots. After 24h of use outdoors the boots were carefully cleaned, and all plant fragments were collected. Afterwards, all plant material was examined to identify the species. In the second experiment, fresh material of nine bryophyte species was kept in a shed in adverse conditions for 18 months, after which DNA was extracted and subjected to genotyping to test the quality of the material. Both experiments give support for the usability of bryophyte material in forensic studies. The bryophyte fragments become attached to shoes, where they remain even after the wearer walks on a dry road for several hours. Bryophyte DNA stays intact, allowing DNA profiling after lengthy periods following detachment from the original plant source. Based on these experiments, and considering the fact that many bryophytes are clonal plants, we propose that bryophytes are among the most usable plants to provide botanical evidence for forensic investigations.
Usability testing and requirements derivation for EMU-compatible electrical connectors
NASA Technical Reports Server (NTRS)
Reaux, Ray A.; Griffin, Thomas J.; Lewis, Ruthan
1989-01-01
On-orbit servicing of payloads is simplified when a spacecraft has been designed for serviceability. A key design criterion for a serviceable spaceraft is standardization of electrical connectors. This paper investigates the effects of extravehicular mobility unit (EMU) glove size, connector size, and connector type on usability of electrical connectors. An experiment was conducted exploring participants' ability to mate and demate connectors in an evacuated glovebox. Independent variables were two EMU glove-sizes, five connector size groups, and seven connector types. Significant differences in performance times and heart rate changes during mate and demate operations were found. Subjective assessments of connectors were collected from participants with a usability questionnaire. The data were used to derive design recommendations for a NASA-recommended EMU-compatible electrical connector.
NASA Astrophysics Data System (ADS)
Wang, Rong; Chen, Jing M.; Pavlic, Goran; Arain, Altaf
2016-09-01
Winter leaf area index (LAI) of evergreen coniferous forests exerts strong control on the interception of snow, snowmelt and energy balance. Simulation of winter LAI and associated winter processes in land surface models is challenging. Retrieving winter LAI from remote sensing data is difficult due to cloud contamination, poor illumination, lower solar elevation and higher radiation reflection by snow background. Underestimated winter LAI in evergreen coniferous forests is one of the major issues limiting the application of current remote sensing LAI products. It has not been fully addressed in past studies in the literature. In this study, we used needle lifespan to correct winter LAI in a remote sensing product developed by the University of Toronto. For the validation purpose, the corrected winter LAI was then used to calculate land surface albedo at five FLUXNET coniferous forests in Canada. The RMSE and bias values for estimated albedo were 0.05 and 0.011, respectively, for all sites. The albedo map over coniferous forests across Canada produced with corrected winter LAI showed much better agreement with the GLASS (Global LAnd Surface Satellites) albedo product than the one produced with uncorrected winter LAI. The results revealed that the corrected winter LAI yielded much greater accuracy in simulating land surface albedo, making the new LAI product an improvement over the original one. Our study will help to increase the usability of remote sensing LAI products in land surface energy budget modeling.
The N-CODES project moves to user testing.
Chin, Elizabeth F; Sosa, Mary-Elizabeth; O'Neill, Eileen S
2006-01-01
For a technology to be implemented successfully, it must be thoroughly tested by the stakeholders who will use it in practice. This article reports on the user testing of the Nurse Computer Decision Support working prototype. Ten acute care nurses with varying levels of education and experience participated in the testing. The study's protocol consisted of a series of tasks requiring the participants to use the system while solving patient problems. Both quantitative and qualitative data on usability, ease of navigation, and nurse satisfaction were collected. The nurses ranked usability and ease of navigation highly. Nurses were excited about the system's clinical potential and felt that it would be useful to all practitioners regardless of experience. Testing the system in an actual clinical setting is the next step, but it is clear that the system has extraordinary potential to improve clinical decision making and patient outcomes.
Neville, Carolyn; Da Costa, Deborah; Rochon, Murray; Peschken, Christine A; Pineau, Christian A; Bernatsky, Sasha; Keeling, Stephanie; Avina-Zubieta, Antonio; Lye, Elizabeth; Eng, Davy; Fortin, Paul R
2016-05-30
Systemic Lupus Erythematosus (SLE) is a serious, complex, and chronic illness. Similar to most other chronic illness states, there is great interest in helping persons with SLE engage in their disease management. The objectives of this study were to (1) develop the Lupus Interactive Navigator (LIN), a web-based self-management program for persons with SLE, and (2) test the LIN for usability and acceptability. The LIN development platform was based on the results of preliminary comprehensive needs assessments and adapted from the Oncology Interactive Navigator, a web-based tool developed for persons with cancer. Medical researchers, writers, designers, and programmers worked with clinical experts and persons with SLE to develop content for the LIN. Usability and acceptability of the LIN was tested on individuals with SLE meeting American College of Rheumatology criteria, who were recruited from five Canadian SLE clinics. Participants were provided with access to the LIN and were asked to use it over a two-week period. Following the testing period, participants were contacted for a 30-minute telephone interview to assess usability and acceptability. The content for the LIN was subdivided into six primary information topics with interview videos featuring rheumatologists, allied health professionals, and persons with SLE. Usability and acceptability of the LIN was tested on 43 females with SLE. Of these, 37 (86%) completed telephone interviews. The average age was 43.6 (SD 15.9) years and disease duration averaged 14.1 (SD 10.8) years. Median time spent on LIN was 16.3 (interquartile range [IQR]:13.7, 53.5) minutes and median number of sessions was 2 (IQR: 1, 3). Overall, Likert ratings (0=strongly disagree; 7=strongly agree) of website usability and content were very high, with 75% scoring >6 out of 7 on all items. All participants agreed that LIN was easy to use, would recommend it to others with SLE, and would refer to it for future questions about SLE. Very high ratings were also given to relevancy, credibility, and usefulness of the information provided. Overall, 73% of the participants rated all topics helpful to very helpful. Participants who reported more prior knowledge about SLE rated items regarding improvement in knowledge and helpfulness relatively lower than persons with less prior knowledge. Most participants commented that the LIN would be very useful to those newly diagnosed with SLE. Minor revisions were recommended. This study furthers the understanding of the needs in the SLE community and delivers a unique eHealth tool to promote self-management in persons with SLE. The LIN was found to be highly acceptable in content and usability. The information provided on LIN may be most helpful for individuals with less experience with the disease, such as those newly diagnosed, indicating the need to tailor the content for persons with more SLE experience.
Dixon, Brian E; Kaneshiro, Kellie
2012-01-01
Human immunodeficiency virus and acquired immunodeficiency syndrome (HIV/AIDS) remains a significant international public health challenge. The Statewide HIV/AIDS Information Network (SHINE) Project was created to improve HIV/AIDS health information use and access for health care professionals, patients, and affected communities in Indiana. Our objective was to assess the information-seeking behaviors of health care professionals and consumers who seek information on the testing, treatment, and management of HIV/AIDS and the usability of the SHINE Project's resources in meeting end user needs. The feedback was designed to help SHINE Project members improve and expand the SHINE Project's online resources. A convenience sample of health care professionals and consumers participated in a usability study. Participants were asked to complete typical HIV/AIDS information-seeking tasks using the SHINE Project website. Feedback was provided in the form of standardized questionnaire and usability "think-aloud" responses. Thirteen participants took part in the usability study. Clinicians generally reported the site to be "very good," while consumers generally found it to be "good." Health care professionals commented that they lack access to comprehensive resources for treating patients with HIV/AIDS. They requested new electronic resources that could be integrated in clinical practice and existing information technology infrastructures. Consumers found the SHINE website and its collected information resources overwhelming and difficult to navigate. They requested simpler, multimedia-content rich resources to deliver information on HIV/AIDS testing, treatment, and disease management. Accessibility, usability, and user education remain important challenges that public health and information specialists must address when developing and deploying interventions intended to empower consumers and support coordinated, patient-centric care.
Trafton, Jodie; Martins, Susana; Michel, Martha; Lewis, Eleanor; Wang, Dan; Combs, Ann; Scates, Naquell; Tu, Samson; Goldstein, Mary K
2010-04-01
To develop and evaluate a clinical decision support system (CDSS) named Assessment and Treatment in Healthcare: Evidenced-Based Automation (ATHENA)-Opioid Therapy, which encourages safe and effective use of opioid therapy for chronic, noncancer pain. CDSS development and iterative evaluation using the analysis, design, development, implementation, and evaluation process including simulation-based and in-clinic assessments of usability for providers followed by targeted system revisions. Volunteers provided detailed feedback to guide improvements in the graphical user interface, and content and design changes to increase clinical usefulness, understandability, clinical workflow fit, and ease of completing guideline recommended practices. Revisions based on feedback increased CDSS usability ratings over time. Practice concerns outside the scope of the CDSS were also identified. Usability testing optimized the CDSS to better address barriers such as lack of provider education, confusion in dosing calculations and titration schedules, access to relevant patient information, provider discontinuity, documentation, and access to validated assessment tools. It also highlighted barriers to good clinical practice that are difficult to address with CDSS technology in its current conceptualization. For example, clinicians indicated that constraints on time and competing priorities in primary care, discomfort in patient-provider communications, and lack of evidence to guide opioid prescribing decisions impeded their ability to provide effective, guideline-adherent pain management. Iterative testing was essential for designing a highly usable and acceptable CDSS; however, identified barriers may limit the impact of the ATHENA-Opioid Therapy system and other CDSS on clinical practices and outcomes unless CDSS are paired with parallel initiatives to address these issues.
Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network
Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord
2015-01-01
Background The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM’s semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. Objective The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. Methods In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. Results The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. Conclusions It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively. PMID:27731860
Semantic Indexing of Medical Learning Objects: Medical Students' Usage of a Semantic Network.
Tix, Nadine; Gießler, Paul; Ohnesorge-Radtke, Ursula; Spreckelsen, Cord
2015-11-11
The Semantically Annotated Media (SAM) project aims to provide a flexible platform for searching, browsing, and indexing medical learning objects (MLOs) based on a semantic network derived from established classification systems. Primarily, SAM supports the Aachen emedia skills lab, but SAM is ready for indexing distributed content and the Simple Knowledge Organizing System standard provides a means for easily upgrading or even exchanging SAM's semantic network. There is a lack of research addressing the usability of MLO indexes or search portals like SAM and the user behavior with such platforms. The purpose of this study was to assess the usability of SAM by investigating characteristic user behavior of medical students accessing MLOs via SAM. In this study, we chose a mixed-methods approach. Lean usability testing was combined with usability inspection by having the participants complete four typical usage scenarios before filling out a questionnaire. The questionnaire was based on the IsoMetrics usability inventory. Direct user interaction with SAM (mouse clicks and pages accessed) was logged. The study analyzed the typical usage patterns and habits of students using a semantic network for accessing MLOs. Four scenarios capturing characteristics of typical tasks to be solved by using SAM yielded high ratings of usability items and showed good results concerning the consistency of indexing by different users. Long-tail phenomena emerge as they are typical for a collaborative Web 2.0 platform. Suitable but nonetheless rarely used keywords were assigned to MLOs by some users. It is possible to develop a Web-based tool with high usability and acceptance for indexing and retrieval of MLOs. SAM can be applied to indexing multicentered repositories of MLOs collaboratively.
Lindblom, Katrina; Gregory, Tess; Flight, Ingrid H K; Zajac, Ian
2011-01-01
Objective This study investigated the efficacy of an internet-based personalized decision support (PDS) tool designed to aid in the decision to screen for colorectal cancer (CRC) using a fecal occult blood test. We tested whether the efficacy of the tool in influencing attitudes to screening was mediated by perceived usability and acceptability, and considered the role of computer self-efficacy and computer anxiety in these relationships. Methods Eighty-one participants aged 50–76 years worked through the on-line PDS tool and completed questionnaires on computer self-efficacy, computer anxiety, attitudes to and beliefs about CRC screening before and after exposure to the PDS, and perceived usability and acceptability of the tool. Results Repeated measures ANOVA found that PDS exposure led to a significant increase in knowledge about CRC and screening, and more positive attitudes to CRC screening as measured by factors from the Preventive Health Model. Perceived usability and acceptability of the PDS mediated changes in attitudes toward CRC screening (but not CRC knowledge), and computer self-efficacy and computer anxiety were significant predictors of individuals' perceptions of the tool. Conclusion Interventions designed to decrease computer anxiety, such as computer courses and internet training, may improve the acceptability of new health information technologies including internet-based decision support tools, increasing their impact on behavior change. PMID:21857024
Smith, Philip; Wallace, Melissa; Bekker, Linda-Gail
2016-01-01
Abstract Introduction: Since HIV testing in South African adolescents and young adults is sub-optimal, the objective of the current study was to investigate the feasibility and acceptability of an HIV rapid self-testing device in adolescents and young people at the Desmond Tutu HIV Foundation Youth Centre and Mobile Clinic. Methods: Self-presenting adolescents and young adults were invited to participate in a study investigating the fidelity, usability and acceptability of the AtomoRapid HIV Rapid self-testing device. Trained healthcare workers trained participants to use the device before the participant conducted the HIV self-test with device usage instructions. The healthcare worker then conducted a questionnaire-based survey to assess outcomes. Results: Of the 224 enrolled participants between 16 and 24 years of age, 155 (69,2%) were female. Overall, fidelity was high; 216 (96,4%) participants correctly completed the test and correctly read and interpreted the HIV test result. There were eight (3,6%) user errors overall; six participants failed to prick their finger even though the lancet fired correctly. There were two user errors where participants failed to use the capillary tube correctly. Participants rated acceptability and usability highly, with debut testers giving significantly higher ratings for both. Younger participants gave significantly higher ratings of acceptability. Conclusions: Adolescents and young adults found HIV self-testing highly acceptable with the AtomoRapid and they used the device accurately. Further research should investigate how, where and when to deploy HIV self-testing as a means to accompany existing strategies in reaching the UNAIDS goal to test 90% of all individuals worldwide. PMID:28406597
A usability study of a mobile health application for rural Ghanaian midwives.
Vélez, Olivia; Okyere, Portia Boakye; Kanter, Andrew S; Bakken, Suzanne
2014-01-01
Midwives in rural Ghana work at the frontline of the health care system, where they have access to essential data about the patient population. However, current methods of data capture, primarily pen and paper, make the data neither accessible nor usable for monitoring patient care or program evaluation. Electronic health (eHealth) systems present a potential mechanism for enhancing the roles of midwives by providing tools for collecting, exchanging, and viewing patient data as well as offering midwives the possibility for receiving information and decision support. Introducing such technology in low-resource settings has been challenging because of low levels of user acceptance, software design that does not match the end-user environment, and/or unforeseen challenges such as irregular power availability. These challenges are often attributable to a lack of understanding by the software developers of the end users' needs and work environment. A mobile health (mHealth) application known as mClinic was designed to support midwife access to the Millennium Village-Global Network, an eHealth delivery platform that captures data for managing patient care as well as program evaluation and monitoring, decision making, and management. We conducted a descriptive usability study composed of 3 phases to evaluate an mClinic prototype: 1) hybrid lab-live software evaluation of mClinic to identify usability issues; 2) completion of a usability questionnaire; and 3) interviews that included low-fidelity prototyping of new functionality proposed by midwives. The heuristic evaluation identified usability problems related to 4 of 8 usability categories. Analysis of usability questionnaire data indicated that the midwives perceived mClinic as useful but were more neutral about the ease of use. Analysis of midwives' reactions to low-fidelity prototypes during the interview process supported the applicability of mClinic to midwives' work and identified the need for additional functionality. User acceptance is essential for the success of any mHealth implementation. Usability testing identified mClinic development flaws and needed software enhancements. © 2014 by the American College of Nurse-Midwives.
Development and validation of a remote home safety protocol.
Romero, Sergio; Lee, Mi Jung; Simic, Ivana; Levy, Charles; Sanford, Jon
2018-02-01
Environmental assessments and subsequent modifications conducted by healthcare professionals can enhance home safety and promote independent living. However, travel time, expense and the availability of qualified professionals can limit the broad application of this intervention. Remote technology has the potential to increase access to home safety evaluations. This study describes the development and validation of a remote home safety protocol that can be used by a caregiver of an elderly person to video-record their home environment for later viewing and evaluation by a trained professional. The protocol was developed based on literature reviews and evaluations from clinical and content experts. Cognitive interviews were conducted with a group of six caregivers to validate the protocol. The final protocol included step-by-step directions to record indoor and outdoor areas of the home. The validation process resulted in modifications related to safety, clarity of the protocol, readability, visual appearance, technical descriptions and usability. Our final protocol includes detailed instructions that a caregiver should be able to follow to record a home environment for subsequent evaluation by a home safety professional. Implications for Rehabilitation The results of this study have several implications for rehabilitation practice The remote home safety evaluation protocol can potentially improve access to rehabilitation services for clients in remote areas and prevent unnecessary delays for needed care. Using our protocol, a patient's caregiver can partner with therapists to quickly and efficiently evaluate a patient's home before they are released from the hospital. Caregiver narration, which reflects a caregiver's own perspective, is critical to evaluating home safety. In-home safety evaluations, currently not available to all who need them due to access barriers, can enhance a patient's independence and provide a safer home environment.
Turley, James P; Johnson, Todd R; Smith, Danielle Paige; Zhang, Jaijie; Brixey, Juliana J
2006-04-01
Use of medical devices often directly contributes to medical errors. Because it is difficult or impossible to change the design of existing devices, the best opportunity for improving medical device safety is during the purchasing process. However, most hospital personnel are not familiar with the usability evaluation methods designed to identify aspects of a user interface that do not support intuitive and safe use. A review of medical device operating manuals is proposed as a more practical method of usability evaluation. Operating manuals for five volumetric infusion pumps from three manufacturers were selected for this study (January-April 2003). Each manual's safety message content was evaluated to determine whether the message indicated a device design characteristic that violated known usability principles (heuristics) or indicated a violation of an affordance of the device. "Minimize memory load," with 65 violations, was the heuristic violated most frequently across pumps. Variations between pumps, including the frequency and severity of violations for each, were noted. Results suggest that manual review can provide a proxy for heuristic evaluation of the actual medical device. This method, intended to be a component of prepurchasing evaluation, can complement more formal usability evaluation methods and be used to select a subset of devices for more extensive and formal testing.
Naive (commonsense) geography and geobrowser usability after ten years of Google Earth
NASA Astrophysics Data System (ADS)
Hamerlinck, J. D.
2016-04-01
In 1995, the concept of ‘naive geography’ was formally introduced as an area of cognitive geographic information science representing ‘the body of knowledge that people have about the surrounding geographic world’ and reflecting ‘the way people think and reason about geographic space and time, both consciously and subconsciously’. The need to incorporate such commonsense knowledge and reasoning into design of geospatial technologies was identified but faced challenges in formalizing these relationships and processes in software implementation. Ten years later, the Google Earth geobrowser was released, marking the beginning of a new era of open access to, and application of, geographic data and information in society. Fast-forward to today, and the opportunity presents itself to take stock of twenty years of naive geography and a decade of the ubiquitous virtual globe. This paper introduces an ongoing research effort to explore the integration of naive (or commonsense) geography concepts in the Google Earth geobrowser virtual globe and their possible impact on Google Earth's usability, utility, and usefulness. A multi-phase methodology is described, combining usability reviews and usability testing with use-case scenarios involving the U.S.-Canadian Yellowstone to Yukon Initiative. Initial progress on a usability review combining cognitive walkthroughs and heuristics evaluation is presented.
Navigation in the electronic health record: A review of the safety and usability literature.
Roman, Lisette C; Ancker, Jessica S; Johnson, Stephen B; Senathirajah, Yalini
2017-03-01
Inefficient navigation in electronic health records has been shown to increase users' cognitive load, which may increase potential for errors, reduce efficiency, and increase fatigue. However, navigation has received insufficient recognition and attention in the electronic health record (EHR) literature as an independent construct and contributor to overall usability. Our aims in this literature review were to (1) assess the prevalence of navigation-related topics within the EHR usability and safety research literature, (2) categorize types of navigation actions within the EHR, (3) capture relationships between these navigation actions and usability principles, and (4) collect terms and concepts related to EHR navigation. Our goal was to improve access to navigation-related research in usability. We applied scoping literature review search methods with the assistance of a reference librarian to identify articles published since 1996 that reported evaluation of the usability or safety of an EHR user interface via user test, analytic methods, or inspection methods. The 4336 references collected from MEDLINE, EMBASE, Engineering Village, and expert referrals were de-duplicated and screened for relevance, and navigation-related concepts were abstracted from the 21 articles eligible for review using a standard abstraction form. Of the 21 eligible articles, 20 (95%) mentioned navigation in results and discussion of usability evaluations. Navigation between pages of the EHR was the more frequently documented type of navigation (86%) compared to navigation within a single page (14%). Navigation actions (e.g., scrolling through a medication list) were frequently linked to specific usability heuristic violations, among which flexibility and efficiency of use, recognition rather than recall, and error prevention were most common. Discussion of navigation was prevalent in results across all types of evaluation methods among the articles reviewed. Navigating between multiple screens was frequently identified as a usability barrier. The lack of standard terminology created some challenges to identifying and comparing articles. We observed that usability researchers are frequently capturing navigation-related issues even in articles that did not explicitly state navigation as a focus. Capturing and synthesizing the literature on navigation is challenging because of the lack of uniform vocabulary. Navigation is a potential target for normative recommendations for improved interaction design for safer systems. Future research in this domain, including development of normative recommendations for usability design and evaluation, will be facilitated by development of a standard terminology for describing EHR navigation. Copyright © 2017 Elsevier Inc. All rights reserved.
NASA Astrophysics Data System (ADS)
Hardman, M.; Brodzik, M. J.; Long, D. G.
2017-12-01
Beginning in 1978, the satellite passive microwave data record has been a mainstay of remote sensing of the cryosphere, providing twice-daily, near-global spatial coverage for monitoring changes in hydrologic and cryospheric parameters that include precipitation, soil moisture, surface water, vegetation, snow water equivalent, sea ice concentration and sea ice motion. Historical versions of the gridded passive microwave data sets were produced as flat binary files described in human-readable documentation. This format is error-prone and makes it difficult to reliably include all processing and provenance. Funded by NASA MEaSUREs, we have completely reprocessed the gridded data record that includes SMMR, SSM/I-SSMIS and AMSR-E. The new Calibrated Enhanced-Resolution Brightness Temperature (CETB) Earth System Data Record (ESDR) files are self-describing. Our approach to the new data set was to create netCDF4 files that use standard metadata conventions and best practices to incorporate file-level, machine- and human-readable contents, geolocation, processing and provenance metadata. We followed the flexible and adaptable Climate and Forecast (CF-1.6) Conventions with respect to their coordinate conventions and map projection parameters. Additionally, we made use of Attribute Conventions for Dataset Discovery (ACDD-1.3) that provided file-level conventions with spatio-temporal bounds that enable indexing software to search for coverage. Our CETB files also include temporal coverage and spatial resolution in the file-level metadata for human-readability. We made use of the JPL CF/ACDD Compliance Checker to guide this work. We tested our file format with real software, for example, netCDF Command-line Operators (NCO) power tools for unlimited control on spatio-temporal subsetting and concatenation of files. The GDAL tools understand the CF metadata and produce fully-compliant geotiff files from our data. ArcMap can then reproject the geotiff files on-the-fly and work with other geolocated data such as coastlines, with no special work required. We expect this combination of standards and well-tested interoperability to significantly improve the usability of this important ESDR for the Earth Science community.
Wood, Amanda Ernst; Prins, Annabel; Bush, Nigel E; Hsia, Jennifer F; Bourn, Laura E; Earley, Michael D; Walser, Robyn D; Ruzek, Josef
2017-05-01
This pilot study examined the usability, acceptability, and effectiveness of a free Provider Resilience (PR) mobile application (app) designed by the National Center for Telehealth and Technology to reduce provider burnout. Outpatient mental health providers (N = 30) used the PR app for 1 month. Participants rated the PR app on the System Usability Scale with an overall score of 79.7, which is in the top quartile for usability. Results of paired sample t tests on the Professional Quality of Life Scale indicated significant decreases on the Burnout (t = 3.65, p < .001) and Compassion Fatigue (t = 4.54, p < .001) subscales. The Provider Resilience app shows promise in reducing burnout and compassion fatigue in mental health care providers.
Usability factors of mobile health application for chronic diseases
NASA Astrophysics Data System (ADS)
Zahra, Fatima; Hussain, Azham; Mohd, Haslina
2016-08-01
M-health has changed the conventional delivery system of health-care, permitting continuous, pervasive Health-care anywhere, anytime. Chronic disease apps are increasing, as many health workers, patients and clinicians already embracing smartphones in their comprehensive and diverse practices. There are lots of challenges and requirements that need to be addressed for mobile health applications to prevent or eliminate design problems and minimize potential threats for users, the proposed factors for chronic disease mobile applications can be used as a guide for app developers While, the usability testing, and evaluations of chronic disease apps have not yet touched the accuracy level of other web based applications. This study is being conducted to learn about challenges of m-health apps and to identify the factors that affect the usability of such applications.
Usability Study of Two Collocated Prototype System Displays
NASA Technical Reports Server (NTRS)
Trujillo, Anna C.
2007-01-01
Currently, most of the displays in control rooms can be categorized as status screens, alerts/procedures screens (or paper), or control screens (where the state of a component is changed by the operator). The primary focus of this line of research is to determine which pieces of information (status, alerts/procedures, and control) should be collocated. Two collocated displays were tested for ease of understanding in an automated desktop survey. This usability study was conducted as a prelude to a larger human-in-the-loop experiment in order to verify that the 2 new collocated displays were easy to learn and usable. The results indicate that while the DC display was preferred and yielded better performance than the MDO display, both collocated displays can be easily learned and used.
Eifel field operation campaign supporting Moon Mars and NEO exploration
NASA Astrophysics Data System (ADS)
Kamps, Oscar; Foing, Bernard H.; Offringa, Marloes
2016-07-01
As follow-up on the 2009 Eifel field campaign new field tests with our ExoGeoLab lander were conducted in November 2015 and February 2016. The two phase campaign was used to test the usability of a mock-up lander as test bench for experiments and its remote control in a Moon, Mars analogue environment. In a real mission such a lander could be used in a robotic or manned mission as scientific tool for scientists on Earth to do preliminary study on in-situ collected rocks. This could be useful for example for a sample return mission where scientists on Earth can determine if sample is interesting enough for a more detailed study. The prototype lander is one of the components of the ExoGeoLab project from ESA and ILEWG. Several student projects have prepared the lander for a geological field campaign in lunar and Martian analogue terrain. The lander can be divided in three sections which are used to store several components of the lander. The lower compartment can be used to store a rover or used as laboratory. The middle compartment is used for the lander computer(s), spectrometers and the associated cables. The top plate is used for a telescope which in our case is used to observe the environment around the lander and to guide astronauts during their EVA. As closest volcanic are there is chosen to do the Eifel area, Germany. Several stages of volcanism from Devon till Quaternary resulted in a variation of rocks which is analogue to volcanic rocks from Moon, Mars and other near Earth objects. Several topics we would like to test were pre-defined. Functional tests and demo were performed at European astronaut centre prior to the campaign. The latest updates with respect to the remote control were tested. The pressurised transport vehicle was equipped as remote base for (scientific) support during the campaign. The new instrument set-up were tested and some spectra were measured on collected rocks. The telescope was used to study the environment around the lander, selecting sites of interest for EVA, and as support for astronauts on both safety as science. From this campaign some lessons were learned and are points of improvement for future campaigns. One of the most important is to make the whole lander more robust. Several times some systems were not working correctly and someone had to repair. To make it more self-contained a stable cable system and power supply is needed. The new set-up of the spectrometer and sample holder seemed to work fine with the sun as illumination source. For future campaigns there should be a good artificial source as alternative or complement for solar illumination. The telescope provided a good image with a lot of details of the volcanic ash stratigraphy, but we have experienced the importance for a wider view to have a better understanding of the context of the telescope view. An alternative for an ad-hoc network is preferred. Four computers and two networks seemed to interfere which made it impossible to use systems on the lander at the same time. With the share screen function there was some delay in controlling the computer. Next campaign we would like to have the remote support separated from the field location so the people which have to support astronauts have no understanding of the area. Acknowledgment: We would like to thank people from ESTEC , EAC, and DLR for their support during the campaign.
A parallel coordinates style interface for exploratory volume visualization.
Tory, Melanie; Potts, Simeon; Möller, Torsten
2005-01-01
We present a user interface, based on parallel coordinates, that facilitates exploration of volume data. By explicitly representing the visualization parameter space, the interface provides an overview of rendering options and enables users to easily explore different parameters. Rendered images are stored in an integrated history bar that facilitates backtracking to previous visualization options. Initial usability testing showed clear agreement between users and experts of various backgrounds (usability, graphic design, volume visualization, and medical physics) that the proposed user interface is a valuable data exploration tool.
Colorectal cancer screening patient education materials-how effective is online health information?
John, Elizabeth Sheena; John, Ann M; Hansberry, David R; Thomas, Prashant J; Agarwal, Prateek; Deitch, Christopher; Chokhavatia, Sita
2016-12-01
Patients screened for colorectal cancer (CRC) frequently turn to the Internet to improve their understanding of tests used for detection, including colonoscopy, flexible sigmoidoscopy, fecal occult blood test (FOBT), and CT colonography. It was of interest to determine the quality and readability levels of online health information. The screening tools were googled, and the top 20 results of each test were analyzed for readability, accessibility, usability, and reliability. The 80 articles excluded scientific literature and blogs. We used ten validated readability scales to measure grade levels, and one-way ANOVA and Tukey's honestly statistical different (HSD) post hoc analyses to determine any statistically significant differences among the four diagnostic tests. The LIDA tool assessed overall quality by measuring accessibility, usability, and reliability. The 80 articles were written at an 11.7 grade level, with CT colonography articles written at significantly higher levels than FOBT articles, F(3, 75) = 3.07, p = 0.033. LIDA showed moderate percentages in accessibility (83.9 %), usability (73.0 %), and reliability (75.9 %). Online health information about CRC screening tools are written at higher levels than the National Institute of Health (NIH) and American Medical Association (AMA) recommended third to seventh grade levels. More patients could benefit from this modality of information if it were written at a level and quality that would better facilitate understanding.
Gyori, Miklos; Borsos, Zsófia; Stefanik, Krisztina
2015-01-01
At current, screening for, and diagnosis of, autism spectrum disorders (ASD) are based on purely behavioral data; established screening tools rely on human observation and ratings of relevant behaviors. The research and development project in the focus of this paper is aimed at designing, creating and evaluating a social serious game based multi-modal, interactive software system for screening for high functioning cases of ASD at kindergarten age. The aims of this paper are (1) to summarize the evidence-based design process and (2) to present results from the first usability test of the system. Game topic, candidate responses, and candidate game contents were identified via an iterative literature review. On this basis, the 1st partial prototype of the fully playable game has been created, with complete data recording functionality but without the decision making component. A first usability test was carried out on this prototype (n=13). Overall results were unambiguously promising. Although sporadic difficulties in, and slightly negative attitudes towards, using the game occasionally arose, these were confined to non-target-group children only. The next steps of development include (1) completing the game design; (2) carrying out first large-n field test; (3) creating the first prototype of the decision making component.
A usability assessment on a virtual reality system for panic disorder treatment
NASA Astrophysics Data System (ADS)
Lee, Jaelin; Kawai, Takashi; Yoshida, Nahoko; Izawa, Shuhei; Nomura, Shinobu; Eames, Douglas; Kaiya, Hisanobu
2008-02-01
The authors have developed a virtual reality exposure system that reflects the Japanese culture and environment. Concretely, the system focuses on the subway environment, which is the environment most patients receiving treatment for panic disorder at hospitals in Tokyo, Japan tend to avoid. The system is PC based and features realistic video images and highly interactive functionality. In particular, the system enables instant transformation of the virtual space and allows situations to be freely customized according to the condition and symptoms expressed by each patient. Positive results achieved in therapy assessments aimed at patients with panic disorder accompanying agoraphobia indicate the possibility of indoor treatment. Full utilization of the functionality available requires that the interactive functions be easily operable. Accordingly, there appears to be a need for usability testing aimed at determining whether or not a therapist can operate the system naturally while focusing fully on treatment. In this paper, the configuration of the virtual reality exposure system focusing on the subway environment is outlined. Further, the results of usability tests aimed at assessing how naturally it can be operated while focusing fully on treatment are described.
Development of a Just-in-Time Adaptive mHealth Intervention for Insomnia: Usability Study.
Pulantara, I Wayan; Parmanto, Bambang; Germain, Anne
2018-05-17
Healthy sleep is a fundamental component of physical and brain health. Insomnia, however, is a prevalent sleep disorder that compromises functioning, productivity, and health. Therefore, developing efficient treatment delivery methods for insomnia can have significant societal and personal health impacts. Cognitive behavioral therapy for insomnia (CBTI) is the recommended first-line treatment of insomnia but access is currently limited for patients, since treatment must occur in specialty sleep clinics, which suffer from an insufficient number of trained clinicians. Smartphone-based interventions offer a promising means for improving the delivery of CBTI. Furthermore, novel features such as real-time monitoring and assessment, personalization, dynamic adaptations of the intervention, and context awareness can enhance treatment personalization and effectiveness, and reduce associated costs. Ultimately, this "Just in Time Adaptive Intervention" for insomnia-an intervention approach that is acceptable to patients and clinicians, and is based on mobile health (mHealth) platform and tools-can significantly improve patient access and clinician delivery of evidence-based insomnia treatments. This study aims to develop and assess the usability of a Just in Time Adaptive Intervention application platform called iREST ("interactive Resilience Enhancing Sleep Tactics") for use in behavioral insomnia interventions. iREST can be used by both patients and clinicians. The development of iREST was based on the Iterative and Incremental Development software development model. Requirement analysis was based on the case study's description, workflow and needs, clinician inputs, and a previously conducted BBTI military study/implementation of the Just in Time Adaptive Intervention architecture. To evaluate the usability of the iREST mHealth tool, a pilot usability study was conducted. Additionally, this study explores the feasibility of using an off-the-shelf wearable device to supplement the subjective assessment of patient sleep patterns. The iREST app was developed from the mobile logical architecture of Just in Time Adaptive Intervention. It consists of a cross-platform smartphone app, a clinician portal, and secure 2-way communications platform between the app and the portal. The usability study comprised 19 Active Duty Service Members and Veterans between the ages of 18 and 60. Descriptive statistics based on in-app questionnaires indicate that on average, 12 (mean 12.23, SD 8.96) unique devices accessed the clinician portal per day for more than two years, while the app was rated as "highly usable", achieving a mean System Usability Score score of 85.74 (SD 12.37), which translates to an adjective rating of "Excellent". The participants also gave high scores on "ease of use and learnability" with an average score of 4.33 (SD 0.65) on a scale of 1 to 5. iREST provides a feasible platform for the implementation of Just in Time Adaptive Intervention in mHealth-based and remote intervention settings. The system was rated highly usable and its cross-platformness made it readily implemented within the heavily segregated smartphone market. The use of wearables to track sleep is promising; yet the accuracy of this technology needs further improvement. Ultimately, iREST demonstrates that mHealth-based Just in Time Adaptive Intervention is not only feasible, but also works effectively. ©I Wayan Pulantara, Bambang Parmanto, Anne Germain. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 17.05.2018.
Kurahashi, Allison M; Stinson, Jennifer N; van Wyk, Margaret; Luca, Stephanie; Jamieson, Trevor; Weinstein, Peter; Cafazzo, Joseph A; Lokuge, Bhadra; Cohen, Eyal; Rapoport, Adam
2018-01-01
Background Patients with complex health care needs require the expertise of many health care providers. Communication, collaboration, and patient-centered care positively impact care quality and patient outcomes. Few technologies exist that facilitate collaboration between providers across settings of care and also engage the patient. We developed a Web-based clinical collaboration system, Loop, to address this gap. The likelihood of a technological system’s uptake is associated with its perceived ease of use and perceived usefulness. We engaged stakeholders in the conceptualization and development of Loop in an effort to maximize its intuitiveness and utility. Objective This study aimed to report end users’ perceptions about the ease of use and usefulness of Loop captured during usability tests of Loop. Methods Participants represented three user types (patients, caregivers, and health care providers) recruited from three populations (adults with cancer, adolescents and young adults with cancer, and children with medical complexity). We conducted usability testing over three iterative cycles of testing and development in both laboratory-based and off-site environments. We performed a content analysis of usability testing transcripts to summarize and describe participant perceptions about the ease of use and usefulness of Loop. Results Participants enjoyed testing Loop and were able to use the core functions—composing, posting, and reading messages—with little difficulty. They had difficulty interpreting certain visual cues and design elements or the purpose of some features. This difficulty negatively impacted perceived ease of use but was primarily limited to auxiliary features. Participants predicted that Loop could improve the efficiency and effectiveness of communication between care team members; however, this perceived usefulness could be compromised by disruptions to personal workflow such as additional time or task requirements. Conclusions Loop was perceived to have value as a collaboration system; however, usability testing findings indicate that some design and functional elements need to be addressed to improve ease of use. Additionally, participant concerns highlight the need to consider how a system can be implemented so as to minimize impact on workflow and optimize usefulness. PMID:29317386
Integration of an expert teaching assistant with distance learning software
DOE Office of Scientific and Technical Information (OSTI.GOV)
Fonseca, S.P.; Reed, N.E.
1996-12-31
The Remote Teaching Assistant (RTA) software currently under development at UC Davis allows students and Teaching Assistants (TA`s) to interact through multimedia communication via the Internet. To resolve the problem of TA unavailability and limited knowledge, an Expert Teaching Assistant (ETA) module is being developed. When TA`s are not on-line, students in need of help consult ETA. The focus of this research is the development and integration of ETA with RTA, the establishment of an architecture suitable for use with education (the domain) in any sub-domain (course), and the creation of a mechanism usable by non-technical personnel to maintain knowledgemore » bases.« less
BOREAS Level-3b Landsat TM Imagery: At-sensor Radiances in BSQ Format
NASA Technical Reports Server (NTRS)
Hall, Forrest G. (Editor); Nickeson, Jaime; Knapp, David; Newcomer, Jeffrey A.; Cihlar, Josef
2000-01-01
For BOREAS, the level-3b Landsat TM data, along with the other remotely sensed images, were collected in order to provide spatially extensive information over the primary study areas. This information includes radiant energy, detailed land cover, and biophysical parameter maps such as FPAR and LAI. Although very similar in content to the level-3a Landsat TM products, the level-3b images were created to provide users with a directly usable at-sensor radiance image. Geographically, the level-3b images cover the BOREAS NSA and SSA. Temporally, the images cover the period of 22-Jun-1984 to 09-Jul-1996. The images are available in binary, image format files.
"Mobile technology to improve heart failure outcomes: A proof of concept paper".
Athilingam, Ponrathi; Jenkins, Bradlee A; Zumpano, Heather; Labrador, Miguel A
2018-02-01
Heart failure (HF) causes significant symptom burden and human suffering with considerable economic burden due to hospital readmissions. Targeted interventions to encourage and support self-management behavior is warranted. To test the proof of concept of a mobile application (HeartMapp) in improving self-care management of patients with heart failure. An exploratory inquiry used a field study strategy with purposeful sampling and constant comparative analysis to test the proof of concept of HeartMapp using The Business Model Canvas framework. A total of 125 individuals, who were identified as potential candidates to use the HeartMapp completed the interview over a seven-week period in 2016. Constant comparative analysis indicated themes that Skilled Nursing Facilities had increased readmissions. Participants from Skilled Nursing Facilities reported concern on lack of staffing, star rating, and malpractice claims. Two types of patients were identified as early adapters of technology and those in denial. Health care facilities reported challenges on transitional care, nurses struggle with engagement of patients on self-care management. To avoid readmission penalty, hospitals task home care agencies to keep the patients home for 30-days. While home care agencies rely on remote telemonitoring reported that current telemonitoring devices are costly to maintain, thus exploring novel technology. The Business Model Canvas provided directions for future testing of HeartMapp for its usability as an adjunct device in home health setting to improve self-management and enhance communication with providers, and ultimately reduce readmissions. Copyright © 2017 Elsevier Inc. All rights reserved.
Shin, Joon-Ho; Ryu, Hokyoung; Jang, Seong Ho
2014-03-06
Virtual reality (VR) is not commonly used in clinical rehabilitation, and commercial VR gaming systems may have mixed effects in patients with stroke. Therefore, we developed RehabMaster™, a task-specific interactive game-based VR system for post-stroke rehabilitation of the upper extremities, and assessed its usability and clinical efficacy. A participatory design and usability tests were carried out for development of RehabMaster with representative user groups. Two clinical trials were then performed. The first was an observational study in which seven patients with chronic stroke received 30 minutes of RehabMaster intervention per day for two weeks. The second was a randomised controlled trial of 16 patients with acute or subacute stroke who received 10 sessions of conventional occupational therapy only (OT-only group) or conventional occupational therapy plus 20 minutes of RehabMaster intervention (RehabMaster + OT group). The Fugl-Meyer Assessment score (FMA), modified Barthel Index (MBI), adverse effects, and drop-out rate were recorded. The requirements of a VR system for stroke rehabilitation were established and incorporated into RehabMaster. The reported advantages from the usability tests were improved attention, the immersive flow experience, and individualised intervention. The first clinical trial showed that the RehabMaster intervention improved the FMA (P = .03) and MBI (P = .04) across evaluation times. The second trial revealed that the addition of RehabMaster intervention tended to enhance the improvement in the FMA (P = .07) but did not affect the improvement in the MBI. One patient with chronic stroke left the trial, and no adverse effects were reported. The RehabMaster is a feasible and safe VR system for enhancing upper extremity function in patients with stroke.
2014-01-01
Background Virtual reality (VR) is not commonly used in clinical rehabilitation, and commercial VR gaming systems may have mixed effects in patients with stroke. Therefore, we developed RehabMaster™, a task-specific interactive game-based VR system for post-stroke rehabilitation of the upper extremities, and assessed its usability and clinical efficacy. Methods A participatory design and usability tests were carried out for development of RehabMaster with representative user groups. Two clinical trials were then performed. The first was an observational study in which seven patients with chronic stroke received 30 minutes of RehabMaster intervention per day for two weeks. The second was a randomised controlled trial of 16 patients with acute or subacute stroke who received 10 sessions of conventional occupational therapy only (OT-only group) or conventional occupational therapy plus 20 minutes of RehabMaster intervention (RehabMaster + OT group). The Fugl-Meyer Assessment score (FMA), modified Barthel Index (MBI), adverse effects, and drop-out rate were recorded. Results The requirements of a VR system for stroke rehabilitation were established and incorporated into RehabMaster. The reported advantages from the usability tests were improved attention, the immersive flow experience, and individualised intervention. The first clinical trial showed that the RehabMaster intervention improved the FMA (P = .03) and MBI (P = .04) across evaluation times. The second trial revealed that the addition of RehabMaster intervention tended to enhance the improvement in the FMA (P = .07) but did not affect the improvement in the MBI. One patient with chronic stroke left the trial, and no adverse effects were reported. Conclusions The RehabMaster is a feasible and safe VR system for enhancing upper extremity function in patients with stroke. PMID:24597650
Stark, Lori J; Opipari-Arrigan, Lisa; Filigno, Stephanie S; Simon, Stacey L; Leonard, Amanda; Mogayzel, Peter J; Rausch, Joseph; Zion, Cynthia; Powers, Scott W
2016-06-01
Usability and pilot testing of a web intervention (BeInCharge.org [BIC]) of behavior plus nutrition intervention for children with cystic fibrosis (CF) ages 4-9 years. Think Aloud methodology was used with five mothers to assess usability and refine the intervention. A pilot trial was then conducted with 10 mothers of children with CF ages 4-9 years randomized to the web-based BIC or a Standard Care Control (STC). Change in weight gain for each group was compared in a pre-to-post design. Mothers rated the usability and clarity of BIC highly. The pilot trial showed children of mothers who received BIC had a significant change in weight pre-to-post-treatment (0.67 kg, p = .04). Change for the STC was not significant (0.41 kg, p = .10). A web-based behavior plus nutrition intervention appears promising in increasing weight gain in children with CF. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Evaluating the Usability of Pinchigator, a system for Navigating Virtual Worlds using Pinch Gloves
NASA Technical Reports Server (NTRS)
Hamilton, George S.; Brookman, Stephen; Dumas, Joseph D. II; Tilghman, Neal
2003-01-01
Appropriate design of two dimensional user interfaces (2D U/I) utilizing the well known WIMP (Window, Icon, Menu, Pointing device) environment for computer software is well studied and guidance can be found in several standards. Three-dimensional U/I design is not nearly so mature as 2D U/I, and standards bodies have not reached consensus on what makes a usable interface. This is especially true when the tools for interacting with the virtual environment may include stereo viewing, real time trackers and pinch gloves instead of just a mouse & keyboard. Over the last several years the authors have created a 3D U/I system dubbed Pinchigator for navigating virtual worlds based on the dVise dV/Mockup visualization software, Fakespace Pinch Gloves and Pohlemus trackers. The current work is to test the usability of the system on several virtual worlds, suggest improvements to increase Pinchigator s usability, and then to generalize about what was learned and how those lessons might be applied to improve other 3D U/I systems.
Wang, Jingting; Yao, Nengliang; Shen, Min; Zhang, Xiaoyan; Wang, Yuanyuan; Liu, Yanyan; Geng, Zhaohui; Yuan, Changrong
2016-11-01
Smartphone applications are widely used for self-help interventions in adult cancer survivors. However, applications for parents of pediatric cancer patients are limited. We developed an applications to assist parents of children with acute lymphoblastic leukemia. The aim of this study is to evaluate the app's usability and effectiveness in a preliminary way. A stepwise approach and mixed methods were used. The application was initially tested by healthcare providers, and their comments and suggestions were used to develop an updated version. This version was tested by parents of children with acute lymphoblastic leukemia. Comments and nonverbal expressions of parents were recorded during a 2-week pilot test. The qualitative study was followed by a quantitative study using audit log data from the administration portal to understand how parents use the application. Six healthcare providers and 15 parents participated. Parents gained a greater knowledge of leukemia, confidence in caregiving, social support, and information on how to reduce stress. Over usability was rated as stable, useful, simple, and self-explanatory. No software failure occurred. Applications have the potential to support caregivers of pediatric cancer patients. We plan to address limitations and perform an empirical interventional study to examine its clinical effectiveness.
Shellmer, Diana A.; Dew, Mary Amanda; Mazariegos, George; Dabbs, Annette DeVito
2017-01-01
Applying principles of user-centered design, we iteratively developed and tested the prototype of TPP, an mHealth application to promote medication adherence and enhance communication about medication management between adolescents and primary caregivers. A purposive sample of seven adolescent solid organ transplant recipients who were ≥one yr post-transplant and their primary caregivers participated. Participants completed up to three face-to-face laboratory usability sessions, a 6-week field test, and a debriefing session. Primary caregivers participated in an additional usability telephone session. Participants completed usability and satisfaction measures. Sample included liver (n = 4), heart (n = 2), and lung (n = 1) recipients aged 11–18 yr (57% were female, 86% were Caucasian), and nine primary caregivers aged 42–61 yr (88.9% were parents, 88% were female, 88% were Caucasian). Ninety percent of the adolescents endorsed the graphs or logs of missed/late medication dosing as useful and 100% endorsed the remaining features (e.g., medication list, dose time reminders/warnings) as useful. All adolescents expressed interest in using TPP for monitoring medications and satisfaction with the automatic messaging between adolescent and caregiver versions of the application. Adolescents unanimously found TPP easy to use. TPP shows promise as an mHealth adherence tool. PMID:26916967
Tailored prevention of inpatient falls: development and usability testing of the fall TIPS toolkit.
Zuyev, Lyubov; Benoit, Angela N; Chang, Frank Y; Dykes, Patricia C
2011-02-01
Patient falls and fall-related injuries are serious problems in hospitals. The Fall TIPS application aims to prevent patient falls by translating routine nursing fall risk assessment into a decision support intervention that communicates fall risk status and creates a tailored evidence-based plan of care that is accessible to the care team, patients, and family members. In our design and implementation of the Fall TIPS toolkit, we used the Spiral Software Development Life Cycle model. Three output tools available to be generated from the toolkit are bed poster, plan of care, and patient education handout. A preliminary design of the application was based on initial requirements defined by project leaders and informed by focus groups with end users. Preliminary design partially simulated the paper version of the Morse Fall Scale currently used in hospitals involved in the research study. Strengths and weaknesses of the first prototype were identified by heuristic evaluation. Usability testing was performed at sites where research study is implemented. Suggestions mentioned by end users participating in usability studies were either directly incorporated into the toolkit and output tools, were slightly modified, or will be addressed during training. The next step is implementation of the fall prevention toolkit on the pilot testing units.
Debunking Health IT Usability Myths
Staggers, N.; Xiao, Y.; Chapman, L.
2013-01-01
Poor usability is a threat to patient safety and linked to productivity loss, workflow disruption, user frustration, sub-optimal product use and system de-installations. Although usability is receiving more attention nationally and internationally, myths about usability persist. This editorial debunks five common myths about usability (1) usability only concerns the look and feel of a product and is, therefore, only a minor concern, (2) usability is not measurable, (3) usability stifles innovation, (4) vendors are solely responsible for product usability, and (5) usability methods are not practical for use in healthcare. PMID:23874361
Using Wearable Computers in Shuttle Processing: A Feasibility Study
NASA Technical Reports Server (NTRS)
Centeno, Martha A.; Correa, Daisy; Groh-Hammond, Marcia
2001-01-01
Shuttle processing operations are performed following prescribed instructions compiled in a Work Authorization Document (WAD). Until very recently, WADs were printed so that they could be properly executed, including the buy off of each and every step by the appropriate authorizing agent. However, with the development of EPICs, Maximo, and PeopleSoft applications, some of these documents are now available in electronic format; hence, it is possible for technicians and engineers to access them on line and buy off the steps electronically. To take full advantage of these developments, technicians need access to such documents at the point of job execution. Body wearable computers present an opportunity to develop a WAD delivery system that enables access while preserving technician's mobility, safety levels, and quality of work done. The primary objectives of this project were to determine if body wearable computers are a feasible delivery system for WADs. More specifically, identify and recommend specific brands of body wearable computers readily available on the market. Thus, this effort has field-tested this technology in two areas of shuttle processing, and it has examined the usability of the technology. Results of two field tests and a Human Factors Usability Test are presented. Section 2 provides a description of the body wearable computer technology. Section 3 presents the test at the Space Shuttle Main Engine (SSME) Shop. Section 4 presents the results of the integration test at the Solid Rocket Boosters Assembly and Refurbishing Facility (SRBARF). Section 5 presents the results of the usability test done at the Operations Support Building (OSB).
Usability evaluation of cloud-based mapping tools for the display of very large datasets
NASA Astrophysics Data System (ADS)
Stotz, Nicole Marie
The elasticity and on-demand nature of cloud services have made it easier to create web maps. Users only need access to a web browser and the Internet to utilize cloud based web maps, eliminating the need for specialized software. To encourage a wide variety of users, a map must be well designed; usability is a very important concept in designing a web map. Fusion Tables, a new product from Google, is one example of newer cloud-based distributed GIS services. It allows for easy spatial data manipulation and visualization, within the Google Maps framework. ESRI has also introduced a cloud based version of their software, called ArcGIS Online, built on Amazon's EC2 cloud. Utilizing a user-centered design framework, two prototype maps were created with data from the San Diego East County Economic Development Council. One map was built on Fusion Tables, and another on ESRI's ArcGIS Online. A usability analysis was conducted and used to compare both map prototypes in term so of design and functionality. Load tests were also ran, and performance metrics gathered on both map prototypes. The usability analysis was taken by 25 geography students, and consisted of time based tasks and questions on map design and functionality. Survey participants completed the time based tasks for the Fusion Tables map prototype quicker than those of the ArcGIS Online map prototype. While response was generally positive towards the design and functionality of both prototypes, overall the Fusion Tables map prototype was preferred. For the load tests, the data set was broken into 22 groups for a total of 44 tests. While the Fusion Tables map prototype performed more efficiently than the ArcGIS Online prototype, differences are almost unnoticeable. A SWOT analysis was conducted for each prototype. The results from this research point to the Fusion Tables map prototype. A redesign of this prototype would incorporate design suggestions from the usability survey, while some functionality would need to be dropped. This is a free product and would therefore be the best option if cost is an issue, but this map may not be supported in the future.
Usability of aerial video footage for 3-D scene reconstruction and structural damage assessment
NASA Astrophysics Data System (ADS)
Cusicanqui, Johnny; Kerle, Norman; Nex, Francesco
2018-06-01
Remote sensing has evolved into the most efficient approach to assess post-disaster structural damage, in extensively affected areas through the use of spaceborne data. For smaller, and in particular, complex urban disaster scenes, multi-perspective aerial imagery obtained with unmanned aerial vehicles and derived dense color 3-D models are increasingly being used. These type of data allow the direct and automated recognition of damage-related features, supporting an effective post-disaster structural damage assessment. However, the rapid collection and sharing of multi-perspective aerial imagery is still limited due to tight or lacking regulations and legal frameworks. A potential alternative is aerial video footage, which is typically acquired and shared by civil protection institutions or news media and which tends to be the first type of airborne data available. Nevertheless, inherent artifacts and the lack of suitable processing means have long limited its potential use in structural damage assessment and other post-disaster activities. In this research the usability of modern aerial video data was evaluated based on a comparative quality and application analysis of video data and multi-perspective imagery (photos), and their derivative 3-D point clouds created using current photogrammetric techniques. Additionally, the effects of external factors, such as topography and the presence of smoke and moving objects, were determined by analyzing two different earthquake-affected sites: Tainan (Taiwan) and Pescara del Tronto (Italy). Results demonstrated similar usabilities for video and photos. This is shown by the short 2 cm of difference between the accuracies of video- and photo-based 3-D point clouds. Despite the low video resolution, the usability of these data was compensated for by a small ground sampling distance. Instead of video characteristics, low quality and application resulted from non-data-related factors, such as changes in the scene, lack of texture, or moving objects. We conclude that not only are current video data more rapidly available than photos, but they also have a comparable ability to assist in image-based structural damage assessment and other post-disaster activities.
Code of Federal Regulations, 2010 CFR
2010-10-01
... telecommand operations for flight testing of aircraft and missiles, or their major components. The bands 2310... expendable and re-usable launch vehicles, whether or not such operations involve flight testing: 2364.5, 2370... Flight Test Stations § 87.303 Frequencies. (a) These frequencies are available for assignment to flight...
Ratwani, Raj; Fairbanks, Terry; Savage, Erica; Adams, Katie; Wittie, Michael; Boone, Edna; Hayden, Andrew; Barnes, Janey; Hettinger, Zach; Gettinger, Andrew
2016-11-16
Decisions made during electronic health record (EHR) implementations profoundly affect usability and safety. This study aims to identify gaps between the current literature and key stakeholders' perceptions of usability and safety practices and the challenges encountered during the implementation of EHRs. Two approaches were used: a literature review and interviews with key stakeholders. We performed a systematic review of the literature to identify usability and safety challenges and best practices during implementation. A total of 55 articles were reviewed through searches of PubMed, Web of Science and Scopus. We used a qualitative approach to identify key stakeholders' perceptions; semi-structured interviews were conducted with a diverse set of health IT stakeholders to understand their current practices and challenges related to usability during implementation. We used a grounded theory approach: data were coded, sorted, and emerging themes were identified. Conclusions from both sources of data were compared to identify areas of misalignment. We identified six emerging themes from the literature and stakeholder interviews: cost and resources, risk assessment, governance and consensus building, customization, clinical workflow and usability testing, and training. Across these themes, there were misalignments between the literature and stakeholder perspectives, indicating major gaps. Major gaps identified from each of six emerging themes are discussed as critical areas for future research, opportunities for new stakeholder initiatives, and opportunities to better disseminate resources to improve the implementation of EHRs. Our analysis identified practices and challenges across six different emerging themes, illustrated important gaps, and results suggest critical areas for future research and dissemination to improve EHR implementation.
Zahabi, Maryam; Kaber, David B; Swangnetr, Manida
2015-08-01
The objectives of this study were to (a) review electronic medical record (EMR) and related electronic health record (EHR) interface usability issues, (b) review how EMRs have been evaluated with safety analysis techniques along with any hazard recognition, and (c) formulate design guidelines and a concept for enhanced EMR interfaces with a focus on diagnosis and documentation processes. A major impact of information technology in health care has been the introduction of EMRs. Although numerous studies indicate use of EMRs to increase health care quality, there remain concerns with usability issues and safety. A literature search was conducted using Compendex, PubMed, CINAHL, and Web of Science databases to find EMR research published since 2000. Inclusion criteria included relevant English-language papers with subsets of keywords and any studies (manually) identified with a focus on EMR usability. Fifty studies met the inclusion criteria. Results revealed EMR and EHR usability problems to include violations of natural dialog, control consistency, effective use of language, effective information presentation, and customization principles as well as a lack of error prevention, minimization of cognitive load, and feedback. Studies focusing on EMR system safety made no objective assessments and applied only inductive reasoning methods for hazard recognition. On the basis of the identified usability problems and structure of safety analysis techniques, we provide EMR design guidelines and a design concept focused on the diagnosis process and documentation. The design guidelines and new interface concept can be used for prototyping and testing enhanced EMRs. © 2015, Human Factors and Ergonomics Society.
A Mobile App (BEDSide Mobility) to Support Nurses’ Tasks at the Patient's Bedside: Usability Study
Weinhold, Thomas; Joe, Jonathan; Lovis, Christian; Blondon, Katherine
2018-01-01
Background The introduction of clinical information systems has increased the amount of clinical documentation. Although this documentation generally improves patient safety, it has become a time-consuming task for nurses, which limits their time with the patient. On the basis of a user-centered methodology, we have developed a mobile app named BEDSide Mobility to support nurses in their daily workflow and to facilitate documentation at the bedside. Objective The aim of the study was to assess the usability of the BEDSide Mobility app in terms of the navigation and interaction design through usability testing. Methods Nurses were asked to complete a scenario reflecting their daily work with patients. Their interactions with the app were captured with eye-tracking glasses and by using the think aloud protocol. After completing the tasks, participants filled out the system usability scale questionnaire. Descriptive statistics were used to summarize task completion rates and the users’ performance. Results A total of 10 nurses (aged 21-50) participated in the study. Overall, they were satisfied with the navigation, layout, and interaction design of the app, with the exception of one user who was unfamiliar with smartphones. The problems identified were related to the ambiguity of some icons, the navigation logic, and design inconsistency. Conclusions Besides the usability issues identified in the app, the participants’ results do indicate good usability, high acceptance, and high satisfaction with the developed app. However, the results must be taken with caution because of the poor ecological validity of the experimental setting. PMID:29563074
Facilitating Secure Sharing of Personal Health Data in the Cloud
Nepal, Surya; Glozier, Nick
2016-01-01
Background Internet-based applications are providing new ways of promoting health and reducing the cost of care. Although data can be kept encrypted in servers, the user does not have the ability to decide whom the data are shared with. Technically this is linked to the problem of who owns the data encryption keys required to decrypt the data. Currently, cloud service providers, rather than users, have full rights to the key. In practical terms this makes the users lose full control over their data. Trust and uptake of these applications can be increased by allowing patients to feel in control of their data, generally stored in cloud-based services. Objective This paper addresses this security challenge by providing the user a way of controlling encryption keys independently of the cloud service provider. We provide a secure and usable system that enables a patient to share health information with doctors and specialists. Methods We contribute a secure protocol for patients to share their data with doctors and others on the cloud while keeping complete ownership. We developed a simple, stereotypical health application and carried out security tests, performance tests, and usability tests with both students and doctors (N=15). Results We developed the health application as an app for Android mobile phones. We carried out the usability tests on potential participants and medical professionals. Of 20 participants, 14 (70%) either agreed or strongly agreed that they felt safer using our system. Using mixed methods, we show that participants agreed that privacy and security of health data are important and that our system addresses these issues. Conclusions We presented a security protocol that enables patients to securely share their eHealth data with doctors and nurses and developed a secure and usable system that enables patients to share mental health information with doctors. PMID:27234691
Kuijpers, Wilma; Groen, Wim G; Oldenburg, Hester Sa; Wouters, Michel Wjm; Aaronson, Neil K; van Harten, Wim H
2015-01-22
MijnAVL (MyAVL) is an interactive portal being developed to empower cancer survivors. Literature review and focus groups yielded the selection of features such as access to the electronic medical record (EMR), patient reported outcomes (PROs) and related feedback, and a physical activity support program. Our aim was to present a final design of MijnAVL based on (1) health professionals' evaluation of proposed features, (2) cancer survivors' evaluation of a first draft, and (3) cancer survivors' evaluation of a functional online prototype. Professionals from various disciplines gave input to the content of and procedures related to MijnAVL. Subsequently, 16 cancer survivors participated in an interview to evaluate content and graphic design of a first draft (shown with screenshots). Finally, 7 survivors participated in a usability test with a fully functional prototype. They performed predefined tasks (eg, logging in, finding a test result, completing a questionnaire) while thinking aloud. Descriptive statistics and simple content analysis were used to analyze the data of both the interviews and the usability tests. Professionals supported access to the EMR (eg, histology reports, lab results, and their letters to general practitioners). They also informed the development of PROs and the physical activity support program. Based on the first draft, survivors selected the preferred graphic design, approved the features and provided suggestions for the content (eg, explanation of medical jargon, more concise texts, notification by emails). Usability tests revealed that it was relatively easy to navigate the website and use the different features. Recommendations included, among others, a frequently asked questions section and the use of hyperlinks between different parts of the website. The development of MijnAVL, an interactive portal to empower breast and lung cancer survivors, was performed iteratively and involved multiple groups of end-users. This approach resulted in a usable and understandable final version. Its effectiveness should be determined in further research.
Kuijpers, Wilma; Groen, Wim G; Oldenburg, Hester SA; Wouters, Michel WJM; Aaronson, Neil K
2015-01-01
Background MijnAVL (MyAVL) is an interactive portal being developed to empower cancer survivors. Literature review and focus groups yielded the selection of features such as access to the electronic medical record (EMR), patient reported outcomes (PROs) and related feedback, and a physical activity support program. Objective Our aim was to present a final design of MijnAVL based on (1) health professionals' evaluation of proposed features, (2) cancer survivors’ evaluation of a first draft, and (3) cancer survivors’ evaluation of a functional online prototype. Methods Professionals from various disciplines gave input to the content of and procedures related to MijnAVL. Subsequently, 16 cancer survivors participated in an interview to evaluate content and graphic design of a first draft (shown with screenshots). Finally, 7 survivors participated in a usability test with a fully functional prototype. They performed predefined tasks (eg, logging in, finding a test result, completing a questionnaire) while thinking aloud. Descriptive statistics and simple content analysis were used to analyze the data of both the interviews and the usability tests. Results Professionals supported access to the EMR (eg, histology reports, lab results, and their letters to general practitioners). They also informed the development of PROs and the physical activity support program. Based on the first draft, survivors selected the preferred graphic design, approved the features and provided suggestions for the content (eg, explanation of medical jargon, more concise texts, notification by emails). Usability tests revealed that it was relatively easy to navigate the website and use the different features. Recommendations included, among others, a frequently asked questions section and the use of hyperlinks between different parts of the website. Conclusions The development of MijnAVL, an interactive portal to empower breast and lung cancer survivors, was performed iteratively and involved multiple groups of end-users. This approach resulted in a usable and understandable final version. Its effectiveness should be determined in further research. PMID:25614924
Choo, Min Soo; Jeong, Seong Jin; Cho, Sung Yong; Yoo, Changwon; Jeong, Chang Wook; Ku, Ja Hyeon; Oh, Seung-June
2017-04-01
We aimed to externally validate the prediction model we developed for having bladder outlet obstruction (BOO) and requiring prostatic surgery using 2 independent data sets from tertiary referral centers, and also aimed to validate a mobile app for using this model through usability testing. Formulas and nomograms predicting whether a subject has BOO and needs prostatic surgery were validated with an external validation cohort from Seoul National University Bundang Hospital and Seoul Metropolitan Government-Seoul National University Boramae Medical Center between January 2004 and April 2015. A smartphone-based app was developed, and 8 young urologists were enrolled for usability testing to identify any human factor issues of the app. A total of 642 patients were included in the external validation cohort. No significant differences were found in the baseline characteristics of major parameters between the original (n=1,179) and the external validation cohort, except for the maximal flow rate. Predictions of requiring prostatic surgery in the validation cohort showed a sensitivity of 80.6%, a specificity of 73.2%, a positive predictive value of 49.7%, and a negative predictive value of 92.0%, and area under receiver operating curve of 0.84. The calibration plot indicated that the predictions have good correspondence. The decision curve showed also a high net benefit. Similar evaluation results using the external validation cohort were seen in the predictions of having BOO. Overall results of the usability test demonstrated that the app was user-friendly with no major human factor issues. External validation of these newly developed a prediction model demonstrated a moderate level of discrimination, adequate calibration, and high net benefit gains for predicting both having BOO and requiring prostatic surgery. Also a smartphone app implementing the prediction model was user-friendly with no major human factor issue.
Constantinescu, L; Kim, J; Chan, C; Feng, D
2007-01-01
The field of telemedicine is in need of generic solutions that harness the power of small, easily carried computing devices to increase efficiency and decrease the likelihood of medical errors. Our study resolved to build a framework to bridge the gap between handheld and desktop solutions by developing an automated network protocol that wirelessly propagates application data and images prepared by a powerful workstation to handheld clients for storage, display and collaborative manipulation. To this end, we present the Mobile Active Medical Protocol (MAMP), a framework capable of nigh-effortlessly linking medical workstation solutions to corresponding control interfaces on handheld devices for remote storage, control and display. The ease-of-use, encapsulation and applicability of this automated solution is designed to provide significant benefits to the rapid development of telemedical solutions. Our results demonstrate that the design of this system allows an acceptable data transfer rate, a usable framerate for diagnostic solutions and enough flexibility to enable its use in a wide variety of cases. To this end, we also present a large-scale multi-modality image viewer as an example application based on the MAMP.
Google Maps for Crowdsourced Emergency Routing
NASA Astrophysics Data System (ADS)
Nedkov, S.; Zlatanova, S.
2012-08-01
Gathering infrastructure data in emergency situations is challenging. The affected by a disaster areas are often large and the needed observations numerous. Spaceborne remote sensing techniques cover large areas but they are of limited use as their field of view may be blocked by clouds, smoke, buildings, highways, etc. Remote sensing products furthermore require specialists to collect and analyze the data. This contrasts the nature of the damage detection problem: almost everyone is capable of observing whether a street is usable or not. The crowd is fit for solving these challenges as its members are numerous, they are willing to help and are often in the vicinity of the disaster thereby forming a highly dispersed sensor network. This paper proposes and implements a small WebGIS application for performing shortest path calculations based on crowdsourced information about the infrastructure health. The application is built on top of Google Maps and uses its routing service to calculate the shortest distance between two locations. Impassable areas are indicated on a map by people performing in-situ observations on a mobile device, and by users on a desktop machine who consult a multitude of information sources.
Imagery for Disaster Response and Recovery
NASA Astrophysics Data System (ADS)
Bethel, G. R.
2011-12-01
Exposing the remotely sensed imagery for disaster response and recovery can provide the basis for an unbiased understanding of current conditions. Having created consolidated remotely sensed and geospatial data sources documents for US and Foreign disasters over the past six years, availability and usability are continuing to evolve. By documenting all existing sources of imagery and value added products, the disaster response and recovery community can develop actionable information. The past two years have provided unique situations to use imagery including a major humanitarian disaster and response effort in Haiti, a major environmental disaster in the Gulf of Mexico, a killer tornado in Joplin Missouri and long-term flooding in the Midwest. Each disaster presents different challenges and requires different spatial resolutions, spectral properties and/or multi-temporal collections. The community of data providers continues to expand with organized actives such as the International Charter for Space and Major Disasters and acquisitions by the private sector for the public good rather than for profit. However, data licensing, the lack of cross-calibration and inconsistent georeferencing hinder optimal use. Recent pre-event imagery is a critial component to any disaster response.
Usability of a CKD educational website targeted to patients and their family members.
Diamantidis, Clarissa J; Zuckerman, Marni; Fink, Wanda; Hu, Peter; Yang, Shiming; Fink, Jeffrey C
2012-10-01
Web-based technology is critical to the future of healthcare. As part of the Safe Kidney Care cohort study evaluating patient safety in CKD, this study determined how effectively a representative sample of patients with CKD or family members could interpret and use the Safe Kidney Care website (www.safekidneycare.org), an informational website on safety in CKD. Between November of 2011 and January of 2012, persons with CKD or their family members underwent formal usability testing administered by a single interviewer with a second recording observer. Each participant was independently provided a list of 21 tasks to complete, with each task rated as either easily completed/noncritical error or critical error (user cannot complete the task without significant interviewer intervention). Twelve participants completed formal usability testing. Median completion time for all tasks was 17.5 minutes (range=10-44 minutes). In total, 10 participants had greater than or equal to one critical error. There were 55 critical errors in 252 tasks (22%), with the highest proportion of critical errors occurring when participants were asked to find information on treatments that may damage kidneys, find the website on the internet, increase font size, and scroll to the bottom of the webpage. Participants were generally satisfied with the content and usability of the website. Web-based educational materials for patients with CKD should target a wide range of computer literacy levels and anticipate variability in competency in use of the computer and internet.
Whiteman, Karen L; Lohman, Matthew C; Gill, Lydia E; Bruce, Martha L; Bartels, Stephen J
2017-08-01
To describe the process of adapting an integrated medical and psychiatric self-management intervention to a smartphone application for middle-aged and older adults with serious mental illness using an adaptive systems engineering framework and user-centered design. First, we determined the technical abilities and needs of middle-aged and older adults with serious mental illnesses using smartphones. Then, we developed smartphone content through principles of user-centered design and modified an existing smartphone platform. Finally, we conducted a usability test using "think aloud" and verbal probing. We adapted a psychosocial self-management intervention to a smartphone application and tested its usability. Ten participants (mean age: 55.3 years, SD: 6.2 years) with serious mental illness and comorbid chronic health conditions reported a high level of usability and satisfaction with the smartphone application. Middle-aged and older adults with serious mental illness and limited technical abilities were able to participate in a process involving user-centered design and adaptation of a self-management intervention to be delivered by a smartphone. High usability ratings suggest that middle-aged and older adults with serious mental illness have the potential to use tailored smartphone interventions. Future research is indicated to establish effectiveness and to determine the type and intensity of clinical support needed to successfully implement smartphone applications as a component of community-based services for older adults with psychiatric and medical conditions. Copyright © 2017 American Association for Geriatric Psychiatry. Published by Elsevier Inc. All rights reserved.
Use of Online Machine Translation for Nursing Literature: A Questionnaire-Based Survey
Anazawa, Ryoko; Ishikawa, Hirono; Takahiro, Kiuchi
2013-01-01
Background: The language barrier is a significant obstacle for nurses who are not native English speakers to obtain information from international journals. Freely accessible online machine translation (MT) offers a possible solution to this problem. Aim: To explore how Japanese nursing professionals use online MT and perceive its usability in reading English articles and to discuss what should be considered for better utilisation of online MT lessening the language barrier. Method: In total, 250 randomly selected assistants and research associates at nursing colleges across Japan answered a questionnaire examining the current use of online MT and perceived usability among Japanese nurses, along with the number of articles read in English and the perceived language barrier. The items were rated on Likert scales, and t-test, ANOVA, chi-square test, and Spearman’s correlation were used for analyses. Results: Of the participants, 73.8% had used online MT. More than half of them felt it was usable. The language barrier was strongly felt, and academic degrees and English proficiency level were associated factors. The perceived language barrier was related to the frequency of online MT use. No associated factor was found for the perceived usability of online MT. Conclusion: Language proficiency is an important factor for optimum utilisation of MT. A need for education in the English language, reading scientific papers, and online MT training was indicated. Cooperation with developers and providers of MT for the improvement of their systems is required. PMID:23459140
Hattink, Bart; Droes, Rose-Marie; Sikkes, Sietske; Oostra, Ellen; Lemstra, Afina W
2016-07-21
Dementia is a progressive and highly disabling neurodegenerative disease that will likely become highly prevalent in the future due to the globally aging population. To improve health care efficiency and quality for dementia care, eHealth could help with, for example, an online portal, such as the Digital Alzheimer Center (DAC) of the Vrije Universiteit Medical Center Amsterdam. It provides up-to-date disease information, peer-to-peer contact, and methods for contacting the hospital and health professionals. We aimed to investigate the usability and usefulness of the DAC for patients with dementia and carers to get insight into the feasibility and value of this eHealth app in dementia care and to recommend potential improvements. A descriptive study among patients, carers, and health care professionals was performed. Mixed methods were used, consisting of observations (n=10, 4 people with dementia, 6 carers), an online survey (n=287; 88 patients, 199 carers), and semistructured interviews (n=18; 6 patients, 6 carers, 6 health care professionals). During the observations, participants performed a set of five different prescribed tasks on the portal. Speed, number of errors, and navigation were noted. The online survey aimed to assess users' opinions on the portal's usability and usefulness. Semistructured interviews were conducted in a subsample of patients, carers, and health care professionals to gain more in-depth information. In the usability assessment, eight categories of errors were distinguished, of which three were of critical, two of medium, and three of low severity. In the survey, 45% (40/88) of the patients and 53% (105/199) of the carers indicated they used the portal. In all, 33% (12/36) of patients and 61% (62/102) of carers found it easy to learn to work with the portal. Most considered the DAC generally useful: 65% (17/26) of patients and 78% (67/86) of carers found the DAC useful, especially for understanding dementia (patients: 64%, 16/25; carers: 62%, 53/86). In the semistructured interviews, the site was generally rated positively on usability and usefulness and being well designed. People with dementia and carers indicated it helped them to understand and deal with dementia. To our knowledge, this is the first study investigating the usability and usefulness of an Internet portal especially designed for people with dementia and their carers. An online patient portal could be a useful means to help to support patients and carers in dealing with dementia: the majority of users positively evaluated usability and usefulness of the portal, and appreciated the information on it. However, only a minority of patients found it easy to work with the portal. Good design and frequent usability testing is essential to offer a good online portal.
Amin, Ruhul; Islam, S K Hafizul; Biswas, G P; Khan, Muhammad Khurram; Li, Xiong
2015-11-01
The E-health care systems employ IT infrastructure for maximizing health care resources utilization as well as providing flexible opportunities to the remote patient. Therefore, transmission of medical data over any public networks is necessary in health care system. Note that patient authentication including secure data transmission in e-health care system is critical issue. Although several user authentication schemes for accessing remote services are available, their security analysis show that none of them are free from relevant security attacks. We reviewed Das et al.'s scheme and demonstrated their scheme lacks proper protection against several security attacks such as user anonymity, off-line password guessing attack, smart card theft attack, user impersonation attack, server impersonation attack, session key discloser attack. In order to overcome the mentioned security pitfalls, this paper proposes an anonymity preserving remote patient authentication scheme usable in E-health care systems. We then validated the security of the proposed scheme using BAN logic that ensures secure mutual authentication and session key agreement. We also presented the experimental results of the proposed scheme using AVISPA software and the results ensure that our scheme is secure under OFMC and CL-AtSe models. Moreover, resilience of relevant security attacks has been proved through both formal and informal security analysis. The performance analysis and comparison with other schemes are also made, and it has been found that the proposed scheme overcomes the security drawbacks of the Das et al.'s scheme and additionally achieves extra security requirements.
Julstrom, Stephen; Kozma-Spytek, Linda; Isabelle, Scott
2011-09-01
During the revision of the American National Standards Institute (ANSI) C63.19 and the development of the ANSI/Telecommunications Industry Association-1083 hearing aid compatibility standards, it became evident that additional data concerning user acceptance of interfering magnetic noises generated by wireless and cordless telephones were needed in order to determine the requirements for telecoil-coupling compatibility. Further insight was needed into the magnetic signal-to-noise (S/N) ratios required to achieve specific levels of telephone usability by hearing aid wearers. (A companion article addresses magnetic signal level requirements.) Test subjects used their own hearing aids. The magnetic signals were applied through large magnetic head-worn coils, selected for the field orientation appropriate for each hearing aid. After adjusting their aid's volume control to an acoustic speech reference, the subjects adjusted the applied magnetic signal level to find their Most Comfortable Level (MCL). Each subject then adjusted the levels of six of eight different representative interfering noises to three levels of subjective telephone usability: "usable for a brief call," "acceptable for normal use," and "excellent performance." Each subject's objective noise audibility threshold in the presence of speech was also obtained for the various noise types. The 57 test subjects covered an age range of 22 to 79 yr, with a self-reported hearing loss duration of 12 to 72 yr. All had telecoils that they used for at least some telecommunications needs. The self-reported degree of hearing loss ranged from moderate to profound. A guided intake questionnaire yielded general background information for each subject. A test control box fed by prepared speech and noise recordings from computer files enabled the subject or the tester, depending on the portion of the test, to select A-weighting-normalized noise interference levels in 1.25 dB steps relative to the selected MCL. For each subject for each tested noise type, the values for the selected S/N ratios were recorded for the three categories of subjective usability and the objective noise threshold. About half of the test subjects needed a minimum 21 dB S/N ratio for them to consider their listening experience "acceptable for normal use" of a telephone. With a 30 dB S/N ratio, about 85% of the subjects reported normal use acceptability. Significant differences were apparent in the measured S/N user requirements among the noise types, though, indicating a deficiency in an A-weighted level measurement's ability to consistently predict the subjective acceptability of the various noises. An improved weighting function having both spectral and temporal components was developed to substantially eliminate these predictive inconsistencies. The interfering noise level that subjects chose for a telephone usability rating of "excellent performance" matched closely their objectively measured noise audibility threshold. A rating of "acceptable for normal use" was typically achieved at a 4 dB higher noise level, and a rating of "usable for a brief call," at a 10.4 dB higher noise level. These results did not relate significantly to noise type or to the subject's aided noise-in-speech hearing acuity. American Academy of Audiology.
Dry-powder inhalers in patients with persistent airflow limitation: usability and preference.
Dal Negro, Roberto W; Povero, Massimiliano
2016-01-01
Inhalation devices represent per sé critical factors because they can affect the therapeutic outcomes independently of the drug used. The role of patients' usability and preference (PUP) for Dry Powder Inhalers (DPIs) is high indeed because they can influence the extent of the adherence to treatment and the therapeutic outcomes. Aim of the study was to assess and compare the PUP of three different DPIs in out-patients with persistent airflow limitation due to asthma or COPD. The PUP of three different DPIs (Breezhaler; Genuair; Handihaler) were investigated by means of the Handling Questionnaire in out-patients with persistent airflow limitation needing an inhalation therapy. Patients had to report their preference before and after the nurse's instruction on the handling of each device. The nurse had also to note the critical steps during the patient's procedure for actuation; to count the number of attempts needed for actuating the device properly, and to measure the time (in sec.) required for these procedures. Data were collected up to three attempts per device. Welch test was used for normal distributed variables, while the Wilcoxon test for not normal distributed variables. The χ (2) test and the ANOVA test were also used. Univariate and multivariate regressions were also performed in order to investigate the effect of patients' characteristics and of technical differences of each device on their proper use. Three hundred thirty-three consecutive out-patients (age range 55-58 years, and well matched for gender), with persistent airway limitation of different severity were investigated, suffering from bronchial asthma (n = 175) or from chronic obstructive pulmonary disease (COPD) (n = 158). In particular, 127 patients (38 %) tested the three DPIs, while 110 (33 %) tested Breezhaler and Genuair, and 96 (29 %) Breezhaler and Handihaler. More than 50 % of patients who tested all devices preferred the Genuair and perceived this device as the easiest to use. The nurse's judgement confirmed their opinion. When compared to the other two DPIs, Genuair proved the least problematic either according to the patients' judgement and to the nurse's opinion. Mean number of attempts aimed to achieving the first proper actuation was lower with Genuair than with Breezhaler and Handihaler (1.5 vs 2.5-2.6, p < 0.0001). Finally, Genuair also proved the easiest to use and the least problematic according to the nurse judgement (0.0001), the most easily learned (0.0001), and that one with a successful rate of more than 56 % at the first attempt. Breezhaler and Handihaler needed an average of about one additional attempt to be used properly (p < 0.0001), and their usability proved significantly more difficult (OR of successful rate between 0.15 and 0.17, p < 0.001). In general, older patients needed more attempts to perform their first proper inhalation; their successful rate was lower, and they needed more time to learn how to use devices properly: with Genuair these differences were minimized. The possibility of grading objectively the performance of different DPIs in terms of their usability and therapeutic convenience in daily life represents a crucial operational opportunity to pursue. To note that a substantial discrepancy exists between the patients' belief "at glance" and the patients' effective usability with can be registered with some devices. From a general point of view, devices requiring less manual actions for their actuation confirmed their better usability and proper handling after less attempts. In particular, Genuair came out as the most preferred DPI also when several different aspects of preference and usability are assessed objectively and compared.
A methodological approach for designing a usable ontology-based GUI in healthcare.
Lasierra, N; Kushniruk, A; Alesanco, A; Borycki, E; García, J
2013-01-01
This paper presents a methodological approach to the design and evaluation of an interface for an ontology-based system used for designing care plans for monitoring patients at home. In order to define the care plans, physicians need a tool for creating instances of the ontology and configuring some rules. Our purpose is to develop an interface to allow clinicians to interact with the ontology. Although ontology-driven applications do not necessarily present the ontology in the user interface, it is our hypothesis that showing selected parts of the ontology in a "usable" way could enhance clinician's understanding and make easier the definition of the care plans. Based on prototyping and iterative testing, this methodology combines visualization techniques and usability methods. Preliminary results obtained after a formative evaluation indicate the effectiveness of suggested combination.
A user experience evaluation of Amazon Kindle mobile application
NASA Astrophysics Data System (ADS)
Hussain, Azham; Mkpojiogu, Emmanuel O. C.; Musa, Ja'afaru; Mortada, Salah
2017-10-01
There is a dramatic increase in the development of mobile applications in recent years. This makes the usability evaluation of these mobile applications an important aspect in the advancement and application of technology. In this paper, a laboratory-based usability evaluation was carried out on the Amazon Kindle app using 15 users who performed 5 tasks on the Kindle e-book mobile app. A post-test questionnaire was administered to elicit users' perception on the usability of the application. The results demonstrate that almost all the participants were satisfied with services provided by the Amazon Kindle e-book mobile app. On all the four user experience factors examined, namely, perceived ease-of-use, perceived visibility, perceived enjoyabilty, and perceived efficiency, the evaluation outcome shows that the participants had a good and rich mobile experience with the application.
Boudreaux, Edwin D; Brown, Gregory K; Stanley, Barbara; Sadasivam, Rajani S; Camargo, Carlos A; Miller, Ivan W
2017-05-15
Safety planning is a brief intervention that has become an accepted practice in many clinical settings to help prevent suicide. Even though it is quick compared to other approaches, it frequently requires 20 min or more to complete, which can impede adoption. A self-administered, Web-based safety planning application could potentially reduce clinician time, help promote standardization and quality, and provide enhanced ability to share the created plan. The aim of this study was to design, build, and test the usability of a Web-based, self-administered safety planning application. We employed a user-centered software design strategy led by a multidisciplinary team. The application was tested for usability with a target sample of suicidal patients. Detailed observations, structured usability ratings, and Think Aloud procedures were used. Suicidal ideation intensity and perceived ability to cope were assessed pre-post engagement with the Web application. A total of 30 participants were enrolled. Usability ratings were generally strong, and all patients successfully built a safety plan. However, the completeness of the safety plan varied. The mean number of steps completed was 5.5 (SD 0.9) out of 6, with 90% (27/30) of participants completing at least 5 steps and 67% (20/30) completing all 6 steps. Some safety planning steps were viewed as inapplicable to some individuals. Some confusion in instructions led to modifications to improve understandability of each step. Ratings of suicide intensity after completion of the application were significantly lower than preratings, pre: mean 5.11 (SD 2.9) versus post: mean 4.46 (SD 3.0), t 27 =2.49, P=.02. Ratings of ability to cope with suicidal thoughts after completion of the application were higher than preratings, with the difference approaching statistical significance, pre: mean 5.93 (SD 2.9), post: mean 6.64 (SD 2.4), t 27 =-2.03, P=.05. We have taken the first step toward identifying the components needed to maximize usability of a self-administered, Web-based safety planning application. Results support initial consideration of the application as an adjunct to clinical contact. This allows for the clinician or other personnel to provide clarification, when needed, to help the patient build the plan, and to help review and revise the draft. ©Edwin D Boudreaux, Gregory K Brown, Barbara Stanley, Rajani S Sadasivam, Carlos A Camargo Jr, Ivan W Miller. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.05.2017.
The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence.
Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E; Osborn, Chandra Y
2016-05-12
Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website's benefits can identify barriers to user engagement and maximize future use. We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants' favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also reported difficulty accessing the site and, once accessed, using all of its features. Participants recommended improving the site's user interface to facilitate quick, efficient access to all features and content. Adults with T2DM rated the Diabetes MAP website favorably on surveys, but focus groups gave more in-depth feedback on the user experience (eg, difficulty accessing the site, maximizing all of the site's features and content, and recovering from errors). Appropriate usability testing methods ensure Web-delivered interventions work as intended and any benefits are not diminished by usability challenges.
The Usability of Diabetes MAP: A Web-delivered Intervention for Improving Medication Adherence
Nelson, Lyndsay A; Bethune, Magaela C; Lagotte, Andrea E
2016-01-01
Background Web-delivered interventions are a feasible approach to health promotion. However, if a website is poorly designed, difficult to navigate, and has technical bugs, it will not be used as intended. Usability testing prior to evaluating a website’s benefits can identify barriers to user engagement and maximize future use. Objective We developed a Web-delivered intervention called Diabetes Medication Adherence Promotion (Diabetes MAP) and used a mixed-methods approach to test its usability prior to evaluating its efficacy on medication adherence and glycemic control in a randomized controlled trial. Methods We recruited English-speaking adults with type 2 diabetes mellitus (T2DM) from an academic medical center who were prescribed diabetes medications. A trained research assistant administered a baseline survey, collected medical record information, and instructed participants on how to access Diabetes MAP. Participants were asked to use the site independently for 2 weeks and to provide survey and/or focus group feedback on their experience. We analyzed survey data descriptively and qualitative data thematically to identify participants’ favorable and unfavorable experiences, characterize usability concerns, and solicit recommendations for improving Diabetes MAP. Results Enrolled participants (N=32) were an average of 51.7 ± 11.8 years old, 66% (21/32) female, 60% (19/32) non-Hispanic White, 88% (28/32) had more than 12 years of education, half had household incomes over $50,000, and 78% (25/32) were privately insured. Average duration of diagnosed diabetes was 7.8 ± 6.3 years, average A1c was 7.4 ± 2.0, and 38% (12/32) were prescribed insulin. Of enrolled participants, 91% (29/32) provided survey and/or focus group feedback about Diabetes MAP. On the survey, participants agreed website information was clear and easy to understand, but in focus groups they reported navigational challenges and difficulty overcoming user errors (eg, entering data in an unspecified format). Participants also reported difficulty accessing the site and, once accessed, using all of its features. Participants recommended improving the site’s user interface to facilitate quick, efficient access to all features and content. Conclusions Adults with T2DM rated the Diabetes MAP website favorably on surveys, but focus groups gave more in-depth feedback on the user experience (eg, difficulty accessing the site, maximizing all of the site’s features and content, and recovering from errors). Appropriate usability testing methods ensure Web-delivered interventions work as intended and any benefits are not diminished by usability challenges. PMID:27174496
Constructing an Online Test Framework, Using the Example of a Sign Language Receptive Skills Test
ERIC Educational Resources Information Center
Haug, Tobias; Herman, Rosalind; Woll, Bencie
2015-01-01
This paper presents the features of an online test framework for a receptive skills test that has been adapted, based on a British template, into different sign languages. The online test includes features that meet the needs of the different sign language versions. Features such as usability of the test, automatic saving of scores, and score…
Web-Based Testing: Exploring the Relationship between Hardware Usability and Test Performance
ERIC Educational Resources Information Center
Huff, Kyle; Cline, Melinda; Guynes, Carl S.
2012-01-01
Web-based testing has recently become common in both academic and professional settings. A web-based test is administered through a web browser. Individuals may complete a web-based test at nearly any time and at any place. In addition, almost any computer lab can become a testing center. It is important to understand the environmental issues that…
Federici, Stefano; Stefano, Federici; Borsci, Simone; Stamerra, Gianluca
2010-08-01
A verbal protocol technique, adopted for a web usability evaluation, requires that the users are able to perform a double task: surfing and talking. Nevertheless, when blind users surf by using a screen reader and talk about the way they interact with the computer, the evaluation is influenced by a structural interference: users are forced to think aloud and listen to the screen reader at the same time. The aim of this study is to build up a verbal protocol technique for samples of visual impaired users in order to overcome the limits of concurrent and retrospective protocols. The technique we improved, called partial concurrent thinking aloud (PCTA), integrates a modified set of concurrent verbalization and retrospective analysis. One group of 6 blind users and another group of 6 sighted users evaluated the usability of a website using PCTA. By estimating the number of necessary users by the means of an asymptotic test, it was found out that the two groups had an equivalent ability of identifying usability problems, both over 80%. The result suggests that PCTA, while respecting the properties of classic verbal protocols, also allows to overcome the structural interference and the limits of concurrent and retrospective protocols when used with screen reader users. In this way, PCTA reduces the efficiency difference of usability evaluation between blind and sighted users.
Meldrum, Dara; Glennon, Aine; Herdman, Susan; Murray, Deirdre; McConn-Walsh, Rory
2012-05-01
The aim of this study was to investigate the usability of the Nintendo Wii Fit Plus(®) (NWFP) in the treatment of balance impairment in vestibular and other neurological disease. This was a cross-sectional, quasi-experimental study. Participants (n = 26; mean age 43 ± 14, M13:F13) with quantified balance impairment took part in a 30-minute session on the NWFP using exercises and games that challenge balance. Outcomes included the System Usability Scale (SUS), a numerical rating scale of enjoyment and a post treatment questionnaire. The mean SUS score was high (mean 82 ± 18%) with only two participants rating below 50%. There was a negative correlation of age with SUS scores (r = -0.54; p = 0.004). Mean numerical rating scale score (/10) for enjoyment of the NWFP session was 8.4 ± 3. Of the participants, 88.5% said that they would like to use the NWFP in future treatment. Seventy-three percent reported more enjoyment and motivation than usual physiotherapy. No falls occurred during testing. This study has quantified the usability of the NWFP as a treatment for balance impairment showing high levels of usability and enjoyment with no serious adverse effects. The results of this study may assist physiotherapists in devising novel balance rehabilitation programmes. [Box: see text].
Wildenbos, G A; Peute, Linda; Jaspers, Monique
2018-06-01
With the growing population of older adults as a potential user group of mHealth, the need increases for mHealth interventions to address specific aging characteristics of older adults. The existence of aging barriers to computer use is widely acknowledged. Yet, usability studies show that mHealth still fails to be appropriately designed for older adults and their expectations. To enhance designs of mHealth aimed at older adult populations, it is essential to gain insight into aging barriers that impact the usability of mHealth as experienced by these adults. This study aims to synthesize literature on aging barriers to digital (health) computer use, and explain, map and visualize these barriers in relation to the usability of mHealth by means of a framework. We performed a scoping review to synthesize and summarize reported physical and functional age barriers in relation to digital (mobile) health applications use. Aging barriers reported in the literature were mapped onto usability aspects categorized by Nielsen to explain their influence on user experience of mHealth. A framework (MOLD-US) was developed summarizing the evidence on the influence of aging barriers on mHealth use experienced by older adults. Four key categories of aging barriers influencing usability of mHealth were identified: cognition, motivation, physical ability and perception. Effective and satisfactory use of mHealth by older adults is complicated by cognition and motivation barriers. Physical ability and perceptual barriers further increase the risk of user errors and fail to notice important interaction tasks. Complexities of medical conditions, such as diminished eye sight related to diabetes or deteriorated motor skills as a result of rheumatism, can cause errors in user interaction. This research provides a novel framework for the exploration of aging barriers and their causes influencing mHealth usability in older adults. This framework allows for further systematic empirical testing and analysis of mHealth usability issues, as it enables results to be classified and interpreted based on impediments intrinsic to usability issues experienced by older adults. Importantly, the paper identifies a key need for future research on motivational barriers impeding mhealth use of older adults. More insights are needed in particular to disaggregating normal age related functional changes from specific medical conditions that influence experienced usefulness of mHealth by these adults. Copyright © 2018 Elsevier B.V. All rights reserved.
Grudniewicz, Agnes; Bhattacharyya, Onil; McKibbon, K Ann; Straus, Sharon E
2015-11-04
Printed educational materials (PEMs) are a frequently used tool to disseminate clinical information and attempt to change behavior within primary care. However, their effect on clinician behavior is limited. In this study, we explored how PEMs can be redesigned to better meet the needs of primary care physicians (PCPs) and whether usability and selection can be increased when design principles and user preferences are used. We redesigned a publicly available PEM using physician preferences, design principles, and graphic designer support. We invited PCPs to select their preferred document between the redesigned and original versions in a discrete choice experiment, followed by an assessment of usability with the System Usability Scale and a think aloud process. We conducted this study in both a controlled and opportunistic setting to determine whether usability testing results vary by study location. Think aloud data was thematically analyzed, and results were interpreted using the Technology Acceptance Model. One hundred and eighty four PCPs participated in the discrete choice experiment at the 2014 Family Medicine Forum, a large Canadian conference for family physicians. Of these, 87.7 % preferred the redesigned version. Follow-up interviews were held with a randomly selected group of seven participants. We repeated this in a controlled setting in Toronto, Canada, with a set of 14 participants. Using the System Usability Scale, we found that usability scores were significantly increased with the redesign (p < 0.001). We also found that when PCPs were given the choice between the two versions, they selected the redesigned version as their preferred PEM more often than the original (p < 0.001). Results did not appear to differ between the opportunistic and controlled setting. We used the results of the think aloud process to add to a list of end user preferences developed in a previous study. We found that redesigning a PEM with user preferences and design principles can improve its usability and result in the PEM being selected more often than the original. We feel this finding supports the involvement of the user, application of design principles, and the assistance of a graphic designer in the development of PEMs.
A Student-Friendly Graphical User Interface to Extract Data from Remote Sensing Level-2 Products.
NASA Astrophysics Data System (ADS)
Bernardello, R.
2016-02-01
Remote sensing era has provided an unprecedented amount of publicly available data. The United States National Aeronautics and Space Administration Goddard Space Flight Center (NASA-GSFC) has achieved remarkable results in the distribution of these data to the scientific community through the OceanColor web page (http://oceancolor.gsfc.nasa.gov/). However, the access to these data, is not straightforward and needs a certain investment of time in learning the use of existing software. Satellite sensors acquire raw data that are processed through several steps towards a format usable by the scientific community. These products are distributed in Hierarchical Data Format (HDF) which often represents the first obstacle for students, teachers and scientists not used to deal with extensive matrices. We present here SATellite data PROcessing (SATPRO) a newly developed Graphical User Interface (GUI) designed in MATLAB environment to provide an easy, immediate yet reliable way to select and extract Level-2 data from NASA SeaWIFS and MODIS-Aqua databases for oceanic surface temperature and chlorophyll. Since no previous experience with MATLAB is required, SATPRO allows the user to explore the available dataset without investing any software-learning time. SATPRO is an ideal tool to introduce undergraduate students to the use of remote sensing data in oceanography and can also be useful for research projects at the graduate level.
Remote telescope control of site testing with ASCOM
NASA Astrophysics Data System (ADS)
Ji, Kaifan; Liang, Bo; Peng, Yajie; Wang, Feng
2012-04-01
Remote telescope control is significant important for the astronomical site testing. Basing on ASCOM standard, a prototype of remote telescope control system has been implemented. In this paper, the details of the system design, both server end and client end, are introduced. We tested the prototype on a narrow-band dial-up networking and controlled a real remote telescope successfully. The result indicates that it is effective to control remote telescope and other devices with ASCOM.