Team Rhebok
Usability Report / Ranking
(#1 means most severe, #10 means least severe)
#1: Bug: appearing after the first chat
- Solution: Prevent JACE from popping up after the first conversation.
#2: Scoring system too harsh
- Solution: Up 20-30 points for scoring in order to encourage the users.
#3: Currently there is no autofresh / settings change is unintuitive
- Solution: When you change settings and click save, the user has to manually refresh for the settings to actually update. This is highly unintuitive and should likely be changed to just auto-refresh.
#4: Familiar/unfamiliar with the concept page improvement
- Solution: Add a bar on a scale from 0 to 5 instead of asking yes/no questions. Reject (skip) follow-up questions if scores are 0 or 1.
#5: We need transparency on how scores are calculated
- Solution: On the introduction screen when the user first opens the extension, we could explain the prompt that is used to determine the score so that users are less taken off guard/surprised by their results.
#6: We shouldn’t emphasize things that are not changing/that important
- Solution: Adjust the colors of the text and components that are not as relevant to the user experience so that the user’s attention isn’t drawn toward a misguided part of the UI. The user’s eyes should not be directed to the top of the popup (like the logo or prompt) but rather changes in feedback/the app’s response
#7: The default evaluation score passing threshold is currently too high
- Solution: Lower the default threshold depending on how we modify the second issue (scoring system)
#8: Set guardrails for unethical behavior/questions
- Solution: hard-code the resources (ethical issues)
#9: Might need another tab for toggle?
- Solutions:
-
- Generally make it more intuitive to see
- Move it to “Dashboard”
#10: Too much friction for the user
- Solution: Make the default 1 round of questions
