Different results when logged out and logged in

[Putu61]

Why do search results differ for searches conducted when you are logged out to when you are logged in?

Everything I read about the Airbnb algorithm is about how it works but never have I come across any reference to this issue.
I have reported this issue several times to Airbnb support but nothing has changed.

Let me show you what I am referring to and why it is so important.

Apparently the algorithm is based on the following:

1. Pricing Competitiveness
2. Response Rate and Response Time
3. Reviews and Ratings
4. Booking and Cancellation History
5. Listing Completeness and Descriptions
6. Photos and Visual Appeal
7. Superhost Status
8. Booking Flexibility (e.g., Instant Book)
9. Click-Through Rates (CTR)

I'm sure there are more than these 9 like:

1. Wish List
2. Viewing your Calendar Page regularly
   
3. Include relevant keywords in your title, description, and captions
4. Offer popular amenities

and probably more ...

Here is the issue ...

If I am logged in and search 'Ubud', 9-10 May, 2 guests
This is what I see.

If I am logged out and do the same search,
1. The results are different,
2. The map area displayed is larger and shows results that are not in the requested area.

Some listings appear in both but 
1. Star ratings do not appear to have any relevance 

 

So why is this a bad thing?

1. Someone new to Airbnb finds a place they wish to stay and then creates an account, their search results will  then be different, making it frustrating for them
2. The map area displayed when logged out exceeds the search request and shows listing not for the requested area
3. A host who has worked hard to ensure they appear in the top results doesn't appear to logged out viewers

In short, the same algorithm is not being applied based on the listing criteria alone or when UAT was conducted, no one logged out to do any testing.

If anyone can provide any reasonable explanation, I would love to hear it but I think this is a bug that Airbnb have missed 

[Shelley159 · Accepted solution]

Hi @Putu61 

Yes what you see is exactly how it is, for all of us! 

The reason for the difference between logged-in results and private mode results, is that the logged-in search results are customised for each viewer. Your "logged in" screenshot above shows your own listing first - this is normal, because when we interact with our own listing, we teach the algorithm that we're interested in that listing. It thinks you like that spacious, modern, elegant hotel in Ubud, and it's right!

When you view in private mode, you're removing everything it has learnt about you, and looking at the raw results. This is the view that you should use to optimise your listing - you should pick a date range and see how well you can do in private mode. As you've said, if you rank well in private mode, it doesn't mean you'll necessarily rank well when another logged-in user looks at the same page (because now it's throwing up what it thinks that user wants to see). But it does mean your "raw" chance of ranking well has improved.

Star rating does matter - if your rating drops a bit, your average rank will be a little worse. But price seems to be the biggest factor. The results don't usually show only low-priced listings on the first page, but it rotates fewer high-priced listings into prominent positions. So lowering the price is (unfortunately!) one of the best ways to rank higher in most searches.

[Lorna170]

@Putu61  and  @Shelley159   You also need to take into consideration your "guest" settings -- if your property is on instant book and you have selected guests with a good track record, a person who is not logged in or does not have any previous bookings will see very different results.  It took me a while to realize that I would never see my property (or other nearby properties) when I looked for it without an account (logged out) as my guest preferences required guests with a booking history.

It is also very frustrating for owners and guests alike that AirBnB, in order to market a wide variety of properties, will display results that are geographically distant or do not meet the entered or filtered search criteria.  

[Putu61]

Thank you for the in-site @Lorna170 
The 'guests with a good track record' is the best reason I have heard yet  
I will run tests and let you know

[Shelley159]

Hi @Lorna170 

Your explanation makes a lot of sense, but I can see your listing and that of @Putu61 and my own, all in private mode. These are private mode screenshots:

When I click through to book your listing in private mode, it only gives me the option to Request to book. So it won't go through as an instant booking, but you'll still have a choice as to whether you want to accept me. 

This helps us, because we need to be able to see what goes on in private mode 😀

[Putu61]

Hi @Shelley159 
Thank you for your feedback on this.
I also did an experiment by choosing a place in Brazil I had never heard or looked at and did the same test and again the results were different for logged in and logged out users.

You are talking personalisation which is what social sites and Google do, I double that this is the case for people traveling to an area they have never viewed or been to before.