Project BriefGeneralDiscover Key FactorsFind Aha MomentsExam Aha MomentsProposals

Mixed Methods Product Research

Aha Moments Building: From Where to Travel to How to Travel
Since Airbnb began in 2008, more than 200 million of home listings have provided travelers with a home away from home while touring around the world. The below research findings represent my two-year journey to discover why customers pick certain Airbnb listings versus others while they visit New York. The aim of this research is to provide helpful insights for Airbnb’s Home product design and strategy.

Project Brief

What are travelers looking for in lodging?
I asked myself this question when I was working on my individual course thesis of Urban Economics as a student at the University of Michigan. I wondered what attracted travelers in the big city of New York to the places they chose to stay at during their vacations, business trips, and events. I embarked on a two-year research project to study Airbnb’s popular properties to answer my question. In the process, I analyzed 40k+ home listings and studied 500+ customer reviews.


Research Method

I structured my research into 4 rounds to study Airbnb listings in NYC based on their popularity:
  • I first formed a general understanding of the NYC Airbnb market by analyzing all listings;
  • I then focused on the top 25% of Airbnb's most reviewed listings in NYC to quantitatively examine the big picture as to what drives travelers to choose these listings;
  • I conducted further field interviews to the most popular Airbnb to discover the "Aha Moments" of guests and hosts, as well as their current barriers to get such "Aha Moments";
  • Lastly, I examined the most important factors that influenced travelers' decision making processes on which Airbnb listing to choose through a qualitative study of the top 0.5% of Airbnb's most popular properties in NYC.

Summary of Findings: What did I learn from my research?

A core question for my research is when users get their Aha Moments when they realize the value of Airbnb and become loyal/frequent users.

The quantitative study on the popular properties helped me understand what people view important from the big picture. The qualitative study on the most popular properties helped me discover that people experience two types of Aha Moments. The first Aha Moment makes travelers become loyal/frequent to the website while the second Aha Moment makes travelers become loyal to the listings.

Travelers' Ideal Community for Short-Term Rental

People’s ideal community for short-term rentals while they travel and ideal community for long-term homes are similar.

But these ideal communities are still different in terms of neighborhood and operation styles of Airbnb hosts.

Travelers' Aha Moments

A feeling of getting a great value is key to Aha Moment 1 when travelers discover the value of Airbnb's website.

A feeling of connected with hosts is key to Aha Moment 2 when travelers become loyal to the listing they visited.
The barriers of Airbnb Home product for travelers to experience “Aha Moments”:

Needs

Score of Product

Provide adequate information so that travelers know what to expect

Indicate accessibility to desired activities


Indicate comfortability of properties


Provide a sense of safety


Help travelers find warm and hospitable hosts to build friendship and know more about local culture



Summary of Proposals: How can Airbnb improve its user experience and product to help guests get their Aha Moments?

The solutions I proposed were based on shift the lodging searching questions on Airbnb's site from where travelers want to visit to how they want to experience their destination which can help them get the two types of the Aha Moments. In addition to focusing on the physical location of where travelers are going, I propose that Airbnb provides more filters in its search process that allow travelers to find rentals that match the activities and experiences they want to partake in while visiting a new place. For the sake of brevity, 50% of my recommendations are shown below in this portfolio:
1) Aha Moment 1: To help people feel get a good value from Airbnb's listings

A locale calculator that generates recommended nearby activities.

Experience is at the core of travel. A calculator of locales can help travelers filter homes from trip planning to property booking by offering nearby activities/events recommendations of each property.

A prediction system that understands travelers interests of experiences and activities.

Travelers can thus get home recommendations that fulfill their interests and help them to find a rental that would place them nearby areas with activities of interest.

An improved search filter.

The current filter doesn't fully align with travelers' search behaviors. Current search filters prioritize locales without considering accessibility to transit or activities nearby.

Set a program highlighting homes with unique experiences.

Experiences and homes are often connected. Give extra credit to homes with unique on-site experiences, such as a home in a winery, a home with yoga events, etc.

Highlight transit, nearby events, and reviews on each property page.

Current property pages fail to indicate whether rentals will provide an efficient touring experience for travelers, and this factor is among one of the core considerations for travelers when they decide on a property. The current standard scoring system fails to convey the unique characteristics of each property right away.

2) Aha Moment 2: To help travelers get close connected to the hosts

Highlight homes with different activities and warm, hospitable hosts on the landing page.

Homes that bring different activities and welcoming hosts that support travelers are most important when travelers plan their private trips. (Not all Superhosts are warm and hospitable.)

Distinguish between warm and hospitable hosts from other Superhosts through higher rankings and more promotions.

Current Superhosts don't necessarily represent the most desirable hosts for travelers. Pick the top Superhosts and promote them on the landing page. This strategy can educate other hosts on how to be more desirable for travelers and can also motivate them to be more desirable hosts.

Add Options to inform hosts of guest expectations when booking.

Let hosts know what type of guest experience their travelers want, for example, a focus on privacy or a focus on building a close connection with their host. This factor is especially important for travelers staying in private rooms while sharing a common space.

A More In-depth Look at the Research behind the Recommendations
Research Phase 1

Understanding the Airbnb Market in NYC
The Airbnb market in NYC expanded rapidly. Its listings skyrocketed from 1,500 listings in 2011 to 40,000 listings in 2016, and became a promising competitor to the hotel industry. Airbnb's listings are different from local hotels as they are highly centralized in Manhattan and Brooklyn. Its listings in Brooklyn tend to be popular among group travelers. The general Airbnb market also indicates that travelers' desire to maintain their privacy might influence what lodging accommodations they choose.

Research Phase 2

Airbnb's Most Reviewed Properties: what factors contribute to a property attracting people?
While the market is growing quickly, what Airbnb properties do travelers like? What factors in the hosts' business operations affect whether their properties are popular among travelers? What characteristics do popular listings have that continue to attract travelers? I examined these questions by studying the top 25% of Airbnb's properties which had 10 and more traveler reviews.

Overview of the Popular Properties

Predictions from the Pricing Model

I created a Hedonic pricing model, based on previously established models for the housing market, to discover factors that influence the price of short-term rentals. I was then able to use this analysis to discover what factors travelers look for in their short-term Airbnb rentals in NYC.

In this model, I used Airbnb properties with 10 or more reviews, as well as other public data and maps. This model explains 73 percent of the prices of Airbnb’s most reviewed properties.

Observations: 10,000+
Factors: 28 Adjusted
R-Square: 0.73
Interesting Findings from the Big Picture

Similarities between People Seeking Housings and Short-Term Rentals

Similar to local residents, travelers care about accessibility to the subway, airports and the city center. They also care about proximity to parks and historic districts. Some travelers might also care about being located near major commercial and business centers.

Factors Travelers Look for in Short-Term Rentals:

Noticeably, the operation style of hosts and the characteristics of their properties themselves are important to travelers. In regard to hosts' operation styles, factors such as how many properties a host manages at one time and if hosts offer discounts to their guests influence the price of a short-term rental, and in result, some of the attraction of that rental to travelers. Additionally, significant differences in price among different room types tell us that privacy is an important consideration for travelers when they choose their short-term rentals. Travelers decisions about short-term rentals are also influenced by properties' review ratings online and their capacity to accommodate multiple guests.

Factors Travelers do not Look for in Short-Term Rentals

The neighborhoods that travelers are interested in are not necessarily same as local residents. The average neighborhood rent or sales price barely impact the price model of Airbnb's most reviewed properties! Another difference is that travelers do not care about the bus stations nearby.

Research Phase 3

Field Interviews & User Interviews
After looking at the big picture of what factors are important to travelers in their short-term rentals, I started to examine those factors further. The questions that guided this round of field research included:

       - Why do factors related to hosts' operational styles, property characteristics and location discovered in the second phase of my research become important to travelers?
       - What are the most important things that travelers want from Airbnb Properties?
       - When do they get their Aha Moments?

In order to answer these questions, I conducted 5 field interviews to the most popular properties in the US and also other offsite user interviews.

Why those 5 listings become successful?

How do guests and hosts get their Aha Moments?

Key Factors of Guests' Aha Moment

Research Phase 4

Airbnb's Most Popular Properties: Do Travelers Experience the Same Aha Moment in NYC?
After looking at the big picture of what factors are important to travelers in their short-term rentals as well as understanding the factors of users' Aha Moments from my field interviews, I started to examine if my Aha moment analysis applies to the NYC market.

I tracked the top 0.5% of Airbnb's most reviewed properties (>=150 reviews in 2016) out of its 40,000 total properties listed in NYC. I then conducted studies of the 10 most popular properties which were chosen based on their review growth rate over the past 2 years and their booking rate from May to August 2018.

How are the 2016 top popular properties doing in 2018?

Private Room

67%

private rooms are still in business.

11/60

rooms still in business are 80% occupied in the next 3 months.

69.1%

average growth rate on reviews
Entire Apartment

49%

entire apartments are still in business.

10/51

apartments still in business are 80% occupied in the next 3 months.

62.3%

average growth rate on reviews

What are the characteristics of the 10 most popular properties picked for my study?

150+

Reviews in 2016

80%

Booking rate in the next 3 months

Biggest

increase in reviews
(5 private rooms + 5 entire apartments)

Surprising Finding:

The Factor that is unique to NYC:

Aha Moment Analysis : Aha Moment 1 and Aha Moment 2

Baseline:

Travelers' Perceptions of the Value of their Short-Term Rentals Before and After their Stays

Before booking a place to stay, travelers compare the Airbnb places with hotels that offer similar experiences in terms of 3 characteristics - the comfortability of the interior environment, the properties' accessibility to travelers' desired activities and places in the city, and the sense of safety that the places offer. When all three of these conditions are met for travelers, they are more likely to choose Airbnb if the place is cheaper or if the Airbnb provides more privacy for a large group such as through the rental of an entire apartment.

In addition to the three characteristics above that travelers look for before they book a short-term rental, a fourth characteristic exists that determines whether travelers feel they have gotten a good value from their Airbnb after they have stayed there. This fourth characteristic is the added face-to-face interaction that travelers can have with their hosts, especially for private rooms and shared rooms. If this interaction is positive, people will feel like they received a bonus from the experience by gaining a greater sense of safety and support, making the price a greater value than they expected. If this interaction is negative, people will feel that they received less value from the experience than they expected.

1) Travelers' expectations of their lodging experience sets a baseline criteria for their price comparisons between Airbnb and hotels.

A fair description of what each short-term rental has to offer sets travelers' basic expectations of their lodging experience and is the first step toward building mutual trust between the host and guest. Travelers tend to book an Airbnb place if the price is lower than a hotel that offers a similar quality of environment and amenities as the Airbnb listing. On the other hand, an incomplete description of an Airbnb place might make people hate the Airbnb place right after their arrival if the place does not match the quality and characteristics they expected to find or if the place presents unexpected and unwanted surprises. Once guests find out these untold facts about the places they stay at, they usually lose trust in the hot, and the experience becomes disappointment.
“The description is correct.” “The room looks bigger than the picture… I highly recommend it!”
“They have a cat and didn’t mention it… My boyfriend is severely allergic to cats and we left right away.”

Evaluation of Airbnb's Current Product:

Need

Provide adequate information so that travelers know what to expect

How is Airbnb currently addressing this need



Reasons for Airbnb Score

Airbnb's current product reviewing system offers an "accuracy" scoring section. Travelers can see it right away.

However, the product fails to provide important review information efficiently. Travelers needs to go through long reviews to find import information. In addition, it doesn't provide a place for travelers to communicate their expectations about their lodging arrangements and interactions with their host before booking. For example, a traveler might want a close relationship with their host versus a distant relationship which would include more privacy.

2) Accessibility to desired activities, comfortability and a sense of safety make up travelers' basic needs in a short-term rental.

When travelers search for places that fulfill their basic needs, they will compare hotels with Airbnb properties. When listings have the same level of quality across travelers' basic needs, travelers tend to choose whichever rental has a lower price.
“All I need is a place to crash in.”

Evaluation of Airbnb's Current Product:

Needs

Accessibility to desired activities
Comfortability
Sense of Safety

How is Airbnb currently addressing the needs








Reasons for Airbnb Score

Travelers have different definitions of what makes a rental accessible to desired activities based upon their own interests while traveling in NYC, such as wanting to explore local art and food scenes, enjoy exhibitions, or experience the lifestyle of Upper Manhattan. Yet, all of these activities require travelers to have access to public transit, shared ride, or parking if they drive.

However, the current Airbnb product fails to provide travelers with a way to filter listings by their accessibility to these kinds of activities. For example, filters are not available during the search process to exclude listings that are too far away to walk to local transit, gain access to free parking or catch a shared ride with a service like Uber or Via.
Travelers have different expectations of the comfortability of their lodging. Some people look for 2-star hotels and some look for 5-star hotels. However, the current Airbnb product fails to fulfill travelers needs by not providing clear categories during travelers' search process that indicate different levels of comfortability.
A sense of safety is important for all travelers. Travelers’ sense of safety comes from the Airbnb hosts, the location of the rentals, and the security systems of the houses.

The current product causes some barriers for travelers to feel confident that their rental is safe before they visit it. In contrast to travelers staying at hotels, Airbnb travelers can only know hosts' credibility through Airbnb, instead of multiple online sources. Airbnb currently provides travelers with very limited information about its hosts through reviews and hosts' profiles. Additionally, the travelers can only see partial information about the hosts on their profiles. This limited access to information becomes an even bigger barrier when some pages only have very few and short review, let alone some people are too nice to leave bad reviews when their names are shown publicly. In addition, security systems of Airbnb houses are not indicated on the page either. These information barriers prevent travelers from feeling safe when they choose Airbnb properties online.

3) Travelers tend to be more content with accessibility to desired activities and feel safer after they build good business relationships with responsive hosts.

Help from a host not only makes travelers immediately get familiar with the neighborhood, but also initiates a good business relationship between the travelers and their hosts. Useful opinions, thoughtful help and supportive conversations make travelers feel supported, and in result, relieved while they are traveling in an unfamiliar place.

A responsive host that builds good business relationships with travelers responds to travelers’ messages and solves their problems quickly.

Evaluation of Airbnb's Current Product:

Need

Find responsive hosts to build a good business relationships with travelers

How is Airbnb currently addressing this need



Reasons for Airbnb Score

The current product is doing a good job of linking hosts and travelers together through hosts’ guidebooks, a messaging system. It also gives hosts basic instructions on how to host travelers and encourages hosts to be responsive through the Superhost Program.

4) Warm and hospitable hosts make travelers feel connected.

All the top 10 Airbnb properties make people feel they had received an exceptionally valuable experience from their short-term rentals. Among these top rentals, some properties had reviews with repetitive comments such as “the best experience”, “!”, and “love.” People keep returning to these Airbnb properties run by friendly hosts that make travelers feel welcome, safe, and connected to locals.

A warm and hospitable host is not just simply a responsive host in that they build friendships with travelers. Travelers not only feel safer with support from hosts whom they can trust, but they also experience and understand local culture while staying and talking to these hosts.

A warm and hospitable host is someone who:
   - keeps in touch when travelers are exploring locally
   - can have fun and enjoyable conversations with their guests
   - shares their personal collections such as CDs and books with guests
- prepares a customized experience for travelers, such as setting up a Christmas tree during the holidays or leaving a welcome note for travelers upon arrival.
"When I was lost in the city I messaged/called John and he was available!"
“We have stayed in many fine airbnb but Marc & Carol’s place goes straight to the number 1, I will miss our heated debates with marc about football taking a line from a certain tennis player.”

Evaluation of Airbnb's Current Product:

Need

Help travelers find warm and hospitable hosts

How is Airbnb currently addressing this need




Reasons for Airbnb Score

The Supterhost program separates responsive / warm and hospitable hosts with other hosts but fails to separate warm and hospitable hosts with responsive hosts. Places with warm and hospitable hosts that thrill travelers are not listed on the landing page, either.

As a matter of fact, posting warm and hospitable hosts and their places can not only help travelers find fantastic places, but can also educate other hosts on how to be a better host.

Proposals

Enable Travelers to Explore Homes from Where to How
The above insights reveals the two most important Aha Moments to Airbnb travelers: 1) homes with affordable prices that provide accessibility to different activities and 2) warm and hospitable hosts. The former one enables travelers find value of Airbnb and the latter one enables travelers become loyal to a listing. I cannot know if the latter one will make guests more loyal to Airbnb because of the data limitation. I made an assumption that Aha Moment 2 will further make both guests and hosts more loyal to the website.

The current Airbnb home product only enables travelers to search for homes based on amenities and location, and thus limits travelers from searching for desirable experiences from homes and hosts. This section offers recommendations to connect experience and homes on the current Airbnb home product.

Based on the overall research findings from this study, a strategy is recommended below. The core of the strategy can be narrowed down to two products and a new session on the landing page: a locale calculator that generates recommended nearby activities, a prediction system that understands travelers' interests as far as experiences and activities, and a recommendation session for listings with unique experience and warm hosts. A calculator of locales can help travelers filter homes from trip planning to property booking by offering nearby activity / event recommendations for each property. A prediction system can understand travelers' interests as far as experiences and activities. Travelers can thus get home recommendations that fulfill their interests and help them to find a rental that would place them nearby areas with activities of interest.
Design Recommendations to Help Travelers from Trip Planning to Experience Aha Moments

1. Help travelers plan trips: categorizing homes by nearby and on-site activities, and highlighting compatible hosts on the landing page.

Add a display of homes with different activities/cultures nearby.
Introduce compatible hosts and their listings.
Recommend travelers homes based upon their interests.

2. Help travelers better target properties through their preference on HOW to explore the place

Adding the options to display/filter by:
    - Nearby events/activities (i.e. farmers’ markets, exhibitions)
    - Public transit lines and stations
    - Free Parking

3. Highlight transit, nearby events/activities, and reviews on each property pages.

1) A locale calculator generates recommendations on the nearby events/activities based upon the number of businesses, institutions or scenic spots nearby.  This will also apply to the search filter.
2) The current standard scoring system fails to deliver the feeling of each property efficiently.

4. Let hosts know travelers interaction expectations on the trip

- Wants a responsive host who gives them enough private space

- Wants a compatible host who gives them attention and can have fun conversations