Educational Product Evaluation
Bridging the Gap: An Evaluation of H5P’s Features and Tutorials for Diverse User Expertise
Learning Solution
A comprehensive evaluation report of H5P, examining its features, usability, and the effectiveness of its training materials. Offer recommendations on whether the clients should continue purchasing H5P licensing and whether there is a need for additional in-house training.
The Problem
Clients
BYU Online Administrative Design Team
BYU Student Success Center
Evaluation Questions and Criteria
Personas
Findings
Skills & Tools Used
Evaluation, Analysis, Interviews, Personas, Data Collection & Interpretation, UX Testing
Data Collection Methods
One of our main challenges was conducting cognitive think-alouds, where participants frequently forgot to articulate their ongoing thoughts, actions, and the rationale behind their decisions. Additionally, in interviews, ensuring neutrality in our questioning to avoid influencing responses and introducing bias was a significant hurdle, as we strived to collect impartial data.
My Role
Challenges
Results & Recommendations
The clients want to know if BYU Online should continue paying for H5P licenses for their Instructional Designers and Instructional Design Assistants and if additional training is needed and what types of training are needed.
My role includes interviewing users, observing their interactions, and creating detailed personas to better understand user needs. I also analyzed both quantitative data and qualitative feedback from cognitive think-alouds, which helped shape our comprehensive insights into h5p's functionality and instructional effectiveness.
Based on our analysis, we recommend that the clients continue to purchase H5P licenses for their instructional designers and design assistants. Additionally, we suggest implementing further in-house training to fully leverage H5P's capabilities, enhancing its educational impact.
The clients are pleased with our evaluation and recommendations, and additional training materials are currently being developed as part of their new hire onboarding course.