Top 5 issues with Serena:
Flow and purpose of the app is confusing – severe
Users indicated not understanding what the app actually did and what it is for. To remedy this, we will add context about our app in the onboarding section. We will walk users through the process of creating a shortcut, then walk them through the process of customizing it, and finally show them what statistics they can see about every shortcut that they have made. We will make it clear that creating or deleting a shortcut in the Shortcuts app automatically creates or deletes the shortcut in Serena. We will also make it clear that users can either discover new interventions through the app or use whatever interventions they are currently using.
Shortcut steps can get outdated with different IOS versions – severe
During user testing, we found that our guide was outdated for the most recent IOS version. To mediate this, we must consistently update our shortcut creation instructions for different IOS versions and potentially keep a page with a link to different instructions for each version.
Total Days Used, Effective Rate, and Effective Days confusing data in the profile section of the app – moderate
Users indicated feeling confused by the different data displayed in the profile section of the app. We will make the profile data more interpretable by adding graphics to synthesize the data and fully explaining what each piece of data represents (i.e. instead of saying “effective rate” we will say Percent of the time the intervention is used). This will result in a profile page that requires scrolling to see all the content.
Too much text and lack of motivation on shortcut manual – moderate
Users indicated feeling overwhelmed by the instructions for shortcut creation. Apple does not allow 3rd party applications to directly access the Shortcuts app or perform similar automation tasks like the Shortcuts app. Therefore, we must keep the shortcut manual. To improve the manual, we will put a disclaimer about the length of the shortcut creation process. We will also shorten the blurb that explains the motivation for each step and move it to the top of the page so users know what they are accomplishing in each step. Lastly, we will break up the information more by spreading it across more pages.
Text is too small on all pages – trivial
We will make the font bigger on each page. We will leverage ellipses to maintain a similar visual hierarchy so block text does not overwhelm the screen.
Link to full Usability Report: https://docs.google.com/document/d/1hW1plejxEWf_kxPgQVkkRCKXsWzzrrYcHSCdp6AjCQA/edit?tab=t.0
