Usability Testing Script

Introduction

Hi, thanks for participating in our usability test.

Raggiana is a productivity app focused on accountability groups that help users stay committed to their daily priorities. Users can set three goals for the day, share them with a group, and encourage each other through reactions and comments.

[first impressions: 1-2 minutes] 

First, we would like you to just look at the homepage of our app and tell us what you think. What strikes you about it, and what you think would click on first. For now, don’t actually click on anything. Just let us know what you would click on. Please think out loud so we can understand your thought process.

If there’s confusion about any UI elements – ask the tester what they think the element represents.

[flow 1: adding goals: 1-2 minutes]

Awesome, we’ll go ahead and start with the first task flow. Rewind a few hours back and imagine that today has just started and you’re still in your room. You’re getting ready to leave for the day, but before you do that, take some time to think about what you want to get done today. When you’re ready, post the three most important goals/tasks for today in the ‘cs 247b’ group.

[flow 2: complete a goal: 1-2 minutes] 

Okay, say it’s about midday now and you have just finished [goal 1], what would you do in the app to reflect this? [after updating goal, ask] Would you want to get back to work or spend some time checking out what your friends have been up to?

If get back to work, then continue flow 2…

[flow 2: cont.]

Time flies! The day is almost over. You’re finally done working for the day. Before you get in bed and call it a day, you want to make a quick update to your goals. Update them based on how likely you are in real life to get stuff on your todo list done. How does it feel to mark something off as done compared to leaving it unfinished?

If checking on friends midday, then pivot to flow 3…

[flow 3: react to others’ commitments: 1-2 minutes]

If checking on friends at the end of day, add: “You’re also curious by what your friends managed to do today.”

Imagine the users in this group are a mix of friends and acquaintances. The first person is a close friend and the second person is someone you don’t know as well but got roped into joining this group . Feel free to do whatever you would like on this screen.

If checking on friends midday, return to flow 2… (see flow 2: cont)

Questions after Test:

1. What are your overall thoughts on the app?
2. How easy was it to add and update your goals throughout the day?
3. How do you feel about being able to see and react to others’ updates?
4. What kinds of on-screen reactions, if any, did you expect when you checked off your first task of the day? (probe about whether celebration is enough)
5. Would you join multiple groups?
6. What suggestions do you have for improving the app?

Optional: Questions from Assumptions Test: 

1. How does this experience compare to using a traditional to-do list?
2. Does the idea of sharing your goals with a group change how you think about completing them?
3. How would you normally interact with others in a group like this?
4. What would make you more likely to react or comment on someone’s progress?
5. Would you feel comfortable sharing your own goals with a group like this?
6. What would make this feel more engaging or motivating?

Prototype

Instructions: First make sure you have Expo Go installed (android or iOS) and scan the QR code.