Experiment Overview
link to our more detailed experiment design
We chose to focus on the first test card found in the above link (Sleep Pod Motivation Test) because it was the most central assumption behind our concept and very important to validate before investing further in the feature. The core idea of Sleep Pods is not just that users track sleep, but that social accountability actually motivates them. If that assumption turns out to be false, then the entire value of the feature becomes much weaker, because the social layer is what makes Sleep Pods distinct from a basic sleep reminder or tracking tool.
Test: Sleep Pod Motivation Test
Test Card
We believe that users will feel motivated by Sleep Pods and social accountability, like seeing friends’ progress, streak pressure, and light competition, rather than feeling judged or turned off by it.
To verify that, we will show users a simple prototype of the Sleep Pod feature and walk them through the experience of joining a pod, seeing group progress, and being compared with friends. Then we will interview them and ask how motivating, awkward, stressful, or appealing the feature feels.
And measure how many users say the Sleep Pod feature feels motivating, whether they say they would realistically use it with friends, and what percentage react positively versus negatively to the social accountability aspect.
We are right if a clear majority of users say the Sleep Pod feature feels motivating or helpful, and most say they would be willing to use it with friends instead of avoiding it because it feels annoying, embarrassing, or too intense.
Learning Card
1/4
| Test Card: Sleep Pod Motivation Test |
| Test Manager: Cannon Kissane |
| Test User: Lara Rudar |
| Process:
We believe that users will feel motivated by Sleep Pods and social accountability, like seeing friends’ progress, streak pressure, and light competition, rather than feeling judged or turned off by it. To verify that, we will show users a simple prototype of the Sleep Pod feature and walk them through the experience of joining a pod, seeing group progress, and being compared with friends. Then we will interview them and ask how motivating, awkward, stressful, or appealing the feature feels. And measure the level that the user feels motivated by Sleep Pods, whether they say they would realistically use it with friends, and what percentage react positively versus negatively to the social accountability aspect. We are right if a clear majority of users say the Sleep Pod feature feels motivating or helpful, and most say they would be willing to use it with friends instead of avoiding it because it feels annoying, embarrassing, or too intense. |
| Measurements:
1 (Definitely No), 2 (No), 3 (Not Sure), 4 (Yes), 5 (Definitely Yes) I think the sleep pods feature is a good idea for someone in my life: 5 I think the sleep pods feature would be helpful for me: 4 3 I would use the sleep pods feature: 4 5 3 |
Short Interview Highlights/Quotes:
|
| Takeaway:
The test supports the general thesis that sleep pods are a useful and meaningful feature. It also opens up further questions around how we can ensure it remains productive during classic low sleep periods such as finals. The conversation also highlighted the general trend for phone users, the general fatigue of downloading one more app, especially when a social circle is required for functionality. I do think our app still functions alone, but for the pods two to three friends is ideal. Luckily we don’t require a huge social graph of more than a few friends to see value. |
2/4
| Test Card: Sleep Pod Motivation Test |
| Test Manager: Osose Ewaleifoh |
| Test User: Saba Weatherspoon |
| Process:
We believe that users will feel motivated by Sleep Pods and social accountability, like seeing friends’ progress, streak pressure, and light competition, rather than feeling judged or turned off by it. To verify that, we will show users a simple prototype of the Sleep Pod feature and walk them through the experience of joining a pod, seeing group progress, and being compared with friends. Then we will interview them and ask how motivating, awkward, stressful, or appealing the feature feels. And measure the level that the user feels motivated by Sleep Pods, whether they say they would realistically use it with friends, and what percentage react positively versus negatively to the social accountability aspect. We are right if a clear majority of users say the Sleep Pod feature feels motivating or helpful, and most say they would be willing to use it with friends instead of avoiding it because it feels annoying, embarrassing, or too intense. |
| Measurements:
1 (Definitely No), 2 (No), 3 (Not Sure), 4 (Yes), 5 (Definitely Yes) I think the sleep pods feature is a good idea for someone in my life: 4 I think the sleep pods feature would be helpful for me: 3 4 I would use the sleep pods feature: 4 5 3 |
Short Interview Highlights/Quotes:
|
| Takeaway:
Our assumption was supported by this test. Saba liked the Sleep Pod concept and she said that the lower-stakes accountability could be useful when confined to her friend group, especially because the reasons she tends to stay up are due to social obligations and also casually hanging out with people. She was fine with sharing sleep data. Based on Saba’s test, the Sleep Pods feature seems like it will be useful in driving accountability for earlier bedtimes. |
3/4
| Test Card: Sleep Pod Motivation Test |
| Test Manager: Adrian Mendoza Perez |
| Test User: Allen Yuan |
| Process:
We believe that users will feel motivated by Sleep Pods and social accountability, like seeing friends’ progress, streak pressure, and light competition, rather than feeling judged or turned off by it. To verify that, we will show users a simple prototype of the Sleep Pod feature and walk them through the experience of joining a pod, seeing group progress, and being compared with friends. Then we will interview them and ask how motivating, awkward, stressful, or appealing the feature feels. And measure the level that the user feels motivated by Sleep Pods, whether they say they would realistically use it with friends, and what percentage react positively versus negatively to the social accountability aspect. We are right if a clear majority of users say the Sleep Pod feature feels motivating or helpful, and most say they would be willing to use it with friends instead of avoiding it because it feels annoying, embarrassing, or too intense. |
| Measurements:
1 (Definitely No), 2 (No), 3 (Not Sure), 4 (Yes), 5 (Definitely Yes)
4 I think the sleep pods feature would be helpful for me: 4 4 I would use the sleep pods feature: 4 3 3 |
Short Interview Highlights/Quotes:
|
| Takeaway:
The assumption was mostly validated. Allen responded positively to the Sleep Pods idea and said it felt motivating because of the light competition and accountability. The main hesitation was around sharing sleep data, so the feature seems strongest when it is casual and limited to close friends. |
4/4
| Test Card: Sleep Pod Motivation Test |
| Test Manager: Sujin Lyu |
| Test User: Jermaine Zhao |
| Process:
We believe that users will feel motivated by Sleep Pods and social accountability, like seeing friends’ progress, streak pressure, and light competition, rather than feeling judged or turned off by it. To verify that, we will show users a simple prototype of the Sleep Pod feature and walk them through the experience of joining a pod, seeing group progress, and being compared with friends. Then we will interview them and ask how motivating, awkward, stressful, or appealing the feature feels. And measure the level that the user feels motivated by Sleep Pods, whether they say they would realistically use it with friends, and what percentage react positively versus negatively to the social accountability aspect. We are right if a clear majority of users say the Sleep Pod feature feels motivating or helpful, and most say they would be willing to use it with friends instead of avoiding it because it feels annoying, embarrassing, or too intense. |
| Measurements:
1 (Definitely No), 2 (No), 3 (Not Sure), 4 (Yes), 5 (Definitely Yes)
4 I think the sleep pods feature would be helpful for me: 3 4 I would use the sleep pods feature: 4 5 My friends would feel comfortable sharing sleep data with their friends: 5 |
Short Interview Highlights/Quotes:
|
| Takeaway:
Jermaine thinks the Sleep Pods concept is generally a good idea and believes his friends would likely use it, but he is personally more neutral about how helpful it would be for himself. This suggests he sees the social value of the feature but may not feel strongly motivated to rely on it for his own sleep habits. |
Who we Recruited and Why
We recruited four participants who all reported struggling with going to bed late and who had never used similar sleep or accountability products before. We chose them because they are close to the target audience for Sleep Pods: people who already have a real bedtime problem, but who are not yet biased by strong habits or expectations from competing tools. That made them a useful group for understanding whether the concept itself feels motivating and realistic to potential first-time users.
Pictures demonstrating modifications of Pods based on assumptions learning Card
