The Experts below are selected from a list of 33 Experts worldwide ranked by ideXlab platform
Christian Fegeler - One of the best experts on this subject based on the ideXlab platform.
-
Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study.
JMIR mHealth and uHealth, 2020Co-Authors: Stefan Sigle, Pilar Barriga, Francisco Javier Correa Fernández, Christian Juhra, Steffen Härtel, Christian FegelerAbstract:Background: Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective: The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods: Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results: A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P
-
evaluating Online consumer medication information systems comparative Online Usability Study
Jmir mhealth and uhealth, 2020Co-Authors: Stefan Sigle, Pilar Barriga, Francisco Javier Correa Fernández, Christian Juhra, Steffen Härtel, Christian FegelerAbstract:Background: Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective: The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods: Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results: A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected. Conclusions: The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase Usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
-
Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study (Preprint)
2019Co-Authors: Stefan Sigle, Pilar Barriga, Christian Juhra, Steffen Härtel, Francisco Javier Correa Fernández, Christian FegelerAbstract:BACKGROUND Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. OBJECTIVE The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. METHODS Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. RESULTS A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (<i>P</i>=.02) and task time (<i>P</i>=.03), while physicians did not have significant differences in SUS scores (<i>P</i>=.83) and task time (<i>P</i>=.72). For pharmacists, a significant difference in SUS scores (<i>P</i><.001) and task time (<i>P</i>=.007) was detected. CONCLUSIONS The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase Usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
Stefan Sigle - One of the best experts on this subject based on the ideXlab platform.
-
Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study.
JMIR mHealth and uHealth, 2020Co-Authors: Stefan Sigle, Pilar Barriga, Francisco Javier Correa Fernández, Christian Juhra, Steffen Härtel, Christian FegelerAbstract:Background: Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective: The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods: Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results: A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P
-
evaluating Online consumer medication information systems comparative Online Usability Study
Jmir mhealth and uhealth, 2020Co-Authors: Stefan Sigle, Pilar Barriga, Francisco Javier Correa Fernández, Christian Juhra, Steffen Härtel, Christian FegelerAbstract:Background: Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective: The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods: Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results: A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected. Conclusions: The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase Usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
-
Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study (Preprint)
2019Co-Authors: Stefan Sigle, Pilar Barriga, Christian Juhra, Steffen Härtel, Francisco Javier Correa Fernández, Christian FegelerAbstract:BACKGROUND Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. OBJECTIVE The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. METHODS Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. RESULTS A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (<i>P</i>=.02) and task time (<i>P</i>=.03), while physicians did not have significant differences in SUS scores (<i>P</i>=.83) and task time (<i>P</i>=.72). For pharmacists, a significant difference in SUS scores (<i>P</i><.001) and task time (<i>P</i>=.007) was detected. CONCLUSIONS The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase Usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
Donna Tedesco - One of the best experts on this subject based on the ideXlab platform.
-
Chapter 10 – Ten Keys to Success
Beyond the Usability Lab, 2010Co-Authors: Bill Albert, Tom Tullis, Donna TedescoAbstract:Publisher Summary This chapter brings all the key pieces of information together in the form of 10 keys for carrying out a successful Online Usability Study. These keys can help get the most out of the Study, save money and time, and even enhance the reputations of the user and the team. These keys are not set in stone for every researcher or for every Study. They are dependent on the researcher and the situation. It is hoped that one simply uses the chapter as a guideline when embarking on an Online Usability Study. The ten keys are: choosing the right tool, thinking outside of the (Web) box, testing early in the design phase, comparing alternatives, considering the entire user experience, using the entire research toolkit, exploring data, selling the results, trusting data (within limits), and not having to be an expert but just diving in.
-
Discount Approaches to Building an Online Study
Beyond the Usability Lab, 2010Co-Authors: Bill Albert, Tom Tullis, Donna TedescoAbstract:This chapter provides a set of step-by-step directions for building a personal Online Usability Study using standard Online survey tools and a little bit of HTML and JavaScript. Techniques that allow users to collect task success data, task times, task-based ratings and comments, and posttask ratings and comments, including ratings using the system Usability scale (SUS) are described in the chapter. Online survey tools can be used to present tasks to participants and collect their answers, allowing capturing task success data. One can easily add rating scales to the Online survey to collect task-based ratings, such as how easy or difficult each task was. One can also use conditional logic in an Online survey to collect comments or explanations related to the tasks (e.g., why they gave up on a task or rated it as being very difficult). Using certain Online survey tools, variables can be added to each task that allows capturing task time. Certain Online survey tools also allow randomizing the order of the tasks. With a little bit of HTML and JavaScript, the task window (containing the survey) and the main window (containing the site or prototype being evaluated) can be positioned so that the participant can work with both of them easily. Finally, with a little more HTML and JavaScript, participants can be randomly assigned to different conditions or prototypes.
-
Chapter 5 – Data Preparation
Beyond the Usability Lab, 2010Co-Authors: Bill Albert, Tom Tullis, Donna TedescoAbstract:Publisher Summary This chapter reviews the basic steps in data preparation: downloading data, performing data quality checks, removing participants, removing tasks, recoding variables, and creating new variables. It also focuses on what one needs to do once all data comes in. Techniques for cleaning up data, such as detecting fraudulent participants, running consistency checks, tests of data reliability, identifying outliers, and recoding variables, are reviewed. Data preparation is one of the most important steps in conducting an Online Usability Study. After launching and receiving the data, setting aside at least a small amount of time for preparing data is recommended. Data preparation is about getting data ready for analysis by checking the quality of data, removing problematic participants and tasks, recoding variables, and even creating a few new variables. Data preparation for an Online Usability Study is a little different from typical Online surveys because of the type of data collected. There are more opportunities to have problems with Online Usability data than with a traditional market research survey. Not only self-reported data, but behavioral and clickstream data are to be looked at.
-
Chapter 2 – Planning the Study
Beyond the Usability Lab, 2010Co-Authors: Bill Albert, Tom Tullis, Donna TedescoAbstract:Publisher Summary This chapter reviews important decisions one needs to make about setting up an Online Usability Study. Issues such as Study types, budgets, and time frames are also discussed. These high-level tactical decisions drive a host of other Study characteristics, such as sample sizes, recruiting strategy, and participant compensation. High-level Study goals to budget, timeline, and recruiting are also discussed in the chapter. It is essential to first identify who the target users of the product are and what their main tasks and goals are, using reliable data sources and methods such as contextual inquiry and task analyses. Determining exactly what is to be tested—from a specific label, feature, or function to a full-scale site-wide Usability evaluation—and whether one wants to compare a design against competitors, alternative designs, or past or future designs is also important. One should think about whether it's appropriate to run a between-subjects or within-subjects test. This is partially determined by how many participants are expected and whether ranking or rating a version against each other is desired.
-
Chapter 3 – Designing the Study
Beyond the Usability Lab, 2010Co-Authors: Bill Albert, Tom Tullis, Donna TedescoAbstract:Publisher Summary This chapter is an aid to design the Study, including introducing it, writing effective screener questions, designing tasks, and choosing the right posttask questions. It walks the users through the steps in designing an Online Usability Study and covers all the major sections of a Study in the order a participant would likely encounter them: introductory content, screening and starter questions, tasks, follow-up questions, and wrap up. When creating questions and tasks, it's important to anticipate how one may want to structure the Study results and tie them back to one's business goals. The last thing one will want is to have clients or business partners asking for data that one didn't collect. The introduction should include things such as the purpose and sponsor and contact information to engage their trust, a realistic time estimate, an incentive and any other information to increase motivation, any technical requirements in clear terms, necessary informed consent and/or legal language, and straightforward instructions. Any screening questions should be included at the beginning of the Study and asked in groups or all at once so as not to clue people into what parameters might screen them in or out. The end of the chapter includes a discussion of some special topics, including progress indicators and speed traps.
Pilar Barriga - One of the best experts on this subject based on the ideXlab platform.
-
Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study.
JMIR mHealth and uHealth, 2020Co-Authors: Stefan Sigle, Pilar Barriga, Francisco Javier Correa Fernández, Christian Juhra, Steffen Härtel, Christian FegelerAbstract:Background: Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective: The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods: Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results: A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P
-
evaluating Online consumer medication information systems comparative Online Usability Study
Jmir mhealth and uhealth, 2020Co-Authors: Stefan Sigle, Pilar Barriga, Francisco Javier Correa Fernández, Christian Juhra, Steffen Härtel, Christian FegelerAbstract:Background: Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective: The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods: Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results: A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected. Conclusions: The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase Usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
-
Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study (Preprint)
2019Co-Authors: Stefan Sigle, Pilar Barriga, Christian Juhra, Steffen Härtel, Francisco Javier Correa Fernández, Christian FegelerAbstract:BACKGROUND Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. OBJECTIVE The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. METHODS Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. RESULTS A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (<i>P</i>=.02) and task time (<i>P</i>=.03), while physicians did not have significant differences in SUS scores (<i>P</i>=.83) and task time (<i>P</i>=.72). For pharmacists, a significant difference in SUS scores (<i>P</i><.001) and task time (<i>P</i>=.007) was detected. CONCLUSIONS The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase Usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
Christian Juhra - One of the best experts on this subject based on the ideXlab platform.
-
Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study.
JMIR mHealth and uHealth, 2020Co-Authors: Stefan Sigle, Pilar Barriga, Francisco Javier Correa Fernández, Christian Juhra, Steffen Härtel, Christian FegelerAbstract:Background: Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective: The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods: Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results: A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P
-
evaluating Online consumer medication information systems comparative Online Usability Study
Jmir mhealth and uhealth, 2020Co-Authors: Stefan Sigle, Pilar Barriga, Francisco Javier Correa Fernández, Christian Juhra, Steffen Härtel, Christian FegelerAbstract:Background: Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. Objective: The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. Methods: Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. Results: A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected. Conclusions: The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase Usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
-
Evaluating Online Consumer Medication Information Systems: Comparative Online Usability Study (Preprint)
2019Co-Authors: Stefan Sigle, Pilar Barriga, Christian Juhra, Steffen Härtel, Francisco Javier Correa Fernández, Christian FegelerAbstract:BACKGROUND Medication is the most common intervention in health care, and the number of Online consumer information systems within the pharmaceutical sector is increasing. However, Online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders. OBJECTIVE The objective of this Study was to quantify and compare the Usability of an Online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists. METHODS Quantitative and qualitative data were acquired from patients, physicians, and pharmacists in this Online Usability Study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative Usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system Usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS. RESULTS A total of 137 patients, 81 physicians, and 68 pharmacists participated in this Study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the Study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (<i>P</i>=.02) and task time (<i>P</i>=.03), while physicians did not have significant differences in SUS scores (<i>P</i>=.83) and task time (<i>P</i>=.72). For pharmacists, a significant difference in SUS scores (<i>P</i><.001) and task time (<i>P</i>=.007) was detected. CONCLUSIONS The vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase Usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
