P2 WORK: Assumption Testing

Test Card:

We believe that: Roommate matching helps college students find suitable roommates and improves living experiences for college students. We will confirm this by evaluating both quantifiable and qualitative outcomes. (Critical: Medium/High)

To verify that, we will: Conduct a survey and interviews among college students, both from Stanford and other institutions, who utilized roommate matching systems in their first year. (Test Cost: Low; Data Reliability: Medium)

And measure:

1. Effectiveness of the matching system by evaluating indirect indicators, like continued cohabitation with first-year roommates.
2. Roommate satisfaction levels using direct rating scales and open-ended questions, such as into habits and preferences.
3. Evaluate responses indicating the utilization and efficacy of roommate contract forms.
4. Use percentage indicators, while accounting for demographic differences (e.g., years, institutions, etc.).

*Survey questions are attached at the end

(Time Required: Moderate/Low)

We are right if:

1. A majority of respondents expressed satisfaction with their roommate matching experience.
2. Respondents either continue residing with their first-year roommates or opt to change roommates, based on preferences (e.g., living with friends) beyond dissatisfaction with the match.
3. Students who utilized the roommate contract system report effective conflict resolution and better roommate relationships.

 

Learning Card:

We believe that: Roommate matching helps college students find suitable roommates and improves living experiences for college students.

We observed:  Responses from students with the roommate matching experience during their first year.

1. The average satisfaction score for the roommate matching system is approximately 7.2, indicating a relatively positive satisfaction rate.
2. More than half of the students continued to live with their first-year roommates after completing their initial year.
3. Those who changed roommates often preferred to live with friends. Around 15% found their matched roommates incompatible. The main reasons are incompatible schedules and cleanliness.
4. There is minimal utilization of the provided contract form.

From that we learned that: The existing roommate matching system generally receives positive feedback. More than half of the students continued to live with their initial matches. However, a minority experienced discomfort or opted to switch roommates, often for reasons unrelated to the matching process itself. Additionally, the underutilization of the contract form highlights a potential gap in its perceived usefulness among users.

Therefore, we will: Focus on refining our roommate matching algorithm to enhance the compatibility assessment process. We’ll introduce additional filtering criteria that consider the main (schedules and cleanliness) more nuanced preferences and habits to ensure more accurate matches. We would also like to increase awareness of the roommate contract feature.

 

Notes:

1. Respondents consist of students from specific universities, potentially restricting the experiences represented in the survey.
2. Responses are mostly from seniors and graduate students, possibly affecting how they view their initial roommate matching experience. Sophomores may provide more current insights due to ongoing roommate situations. But I think seniors and grads may provide more objective responses as they have completed their undergraduate living experience.
3. Respondents might avoid negative comments on roommates. Some survey questions might not reflect the facts.
4. The current sample size might not be large enough. We should avoid generalizing findings to all college students. We need to increase respondents for a more representative sample.

Questions:

Demographics

1. What is your current class year? (List of years)
2. Which university are you currently attending? 

Roommate Matching Experience

1. Did you utilize the roommate matching system provided by your university or any other platform for finding a roommate in your first year?
2. Roommate Satisfaction:

1. • On a scale from 1 to 10, how satisfied are you with your first-year roommate match? (1 being very dissatisfied, 10 being very satisfied)
   • Did you and your first-year roommate have similar living habits and expectations? (List of living habits and expectations)

1. • How long did you live with your first-year roommate?
   • If you are no longer living with your first-year roommate, what was the main reason?

1. • If you had the option, would you use the roommate matching system again for your first-year living arrangement?

Contract

1. Did your university provide a roommate contract form or guidelines?
2. If yes, did you and roommates find the roommate contract helpful?