We’ve noticed a lot of discussion lately about the update...
Latest reply
We’ve noticed a lot of discussion lately about the updated Superhost criteria, so we wanted to explain why we made this up...
Latest reply
Many of you have asked us how Airbnb can protect hosts from one-off bad reviews. When this question came up at the most recent Host Q&A, we told you we were working on ways to make the review process more fair for hosts. Specifically, we made 2 promises:
Today, we’re excited to announce two improvements to the review process that directly address these issues. Since these changes have been introduced, we’ve already noticed a tangible uptick in more accurate, fair reviews for hosts, and we hope they solve some of your pain points. Here’s what’s new:
One-off review alerts
We’ve added a step to the review process for guests when they give a host an inconsistent overall rating. For instance, the guest may have given 4-star or higher ratings for all the categories (cleanliness, accuracy, etc.), but then give an overall rating of less than 3 stars.
The new pop up screen asks guests: “Is this right?” And goes on to explain that they rated their overall stay lower than they rated it in specific categories. It gives guests an option to either change the rating or ignore the alert.
This new alert has led to higher overall review ratings for hosts. Since we launched, we’ve seen a 2.8% drop in 3-star reviews and a 3.9% drop in 2-star reviews. While these percentages may seem small, they’re driving real improvements in the accuracy of our review system, and hosts are benefitting.
Location, location, location
We’ve heard from you that the location rating can be particularly frustrating because some of you have experienced guests dinging you in this category, unexpectedly, after great stays. This category is tricky. It gives valuable information to prospective travelers, which we don’t want to lose. At the same time, we hear your concern that you’re being graded for something you can’t control: guests’ opinion of your location. This opinion is inherently subjective—one person’s “rustic rural retreat” may be another’s “too far from public transportation.” So we made it more clear in the review process that guests are rating the accuracy of your location description, rather than the location itself.
Now, when a guest goes to rate you in the location category, if they give you less than 3 stars, they see an explanation: “Was the listing’s location not described accurately?” So far, this has led to a 0.8% increase in the average rating for location.
While we were working on this, we also made similar improvements to the value category. If a guest gives you less than 3 stars there, they’ll see this message: “What would have made this listing a better value?” This has led to a 0.25% increase in the average rating for value.
These changes were designed to begin to address your concerns around unfair reviews, and to help make sure that guests understand what ratings mean. We still have a journey ahead of us to keep making the review system better, and you’ll continue to see updates from us on this throughout the year. Thank you for hosting!
This does not go far enough!!
I recently had the worst Airbnb Host exeprience of my life dealing with the most rude and insensitive customer service rep about a 3-star review I received for something that was not within my control. The fully siutation can be seen here: https://www.airbnb.ca/progress/ratings/24285263 (under Geroge's review and my response).
But, for full disclosure, I will recap the situation below. Based on this situation, I've decided to end my hosting service through Airbnb. It is ludicrous to have a rating against you as a host for something the host cannot control. I've had a long standing 5-star rating, but because someone ignore the listings details and messages about the check in time, and was essentially upset that I didn't accomodate their earlier check in request, I am penalized! How is that even remotely fair to the host??
Full details below:
This is a response to both George and Airbnb.
I was raised to stand up for what is right and fair. Airbnb is just as much to blame here for enabling this review by George when it is so clearly wrong. Airbnb has allowed this 3-star review to stand, which has made my long standing 5-star rating drop to 4.9.
This response is thorough for the simple fact that I firmly believe in full transparency. It includes the verbatim message exchange between myself and George. I fully disagree with George’s “rating” of 3-star and his review. I have spoken with Airbnb in attempt to have it removed, but they have refused to remove it stating it does not violate their review policy; since there is no discrimination or profanity, Airbnb allows the review to stand. Airbnb does not take into account that George is basing his review and rating on a disagreement he has about my check in and check out policy.
The fact is, the check in and check out policy is clearly outlined in the listing description. In my message to George, I further reinforce the policy, but it is clear he ignored it and still chose to arrive in town hoping to be checked in earlier.
The review and rating further penalizes me because George also chose not to actually stay in the Airbnb, even though it was fully setup and available for his use at the check in time. Prior to going to bed that night, George hadn’t arrived. I thought maybe he and his girlfriend decided to grab dinner and would check in later. So, as I do with any guest checking in late, I left the exterior lights on, had the lights on in the studio, music playing, and a diffuser on to have a nice warm welcome. When I woke up the next morning, I discovered the lights were still on and George had not actually stayed there.
It is not my fault that George ignored the listing details, or my messages, and then chose not to stay in the Studio. Those were all things within his control, yet Airbnb feels its appropriate for a guest to be able to rate a host poorly for something they had no control over. In addition, up until this experience, I had nothing but good things to say about Airbnb. It is clear Airbnb has made billions off the backs of hosts who go out of their way to provide exceptional service, but when push comes to shove, they do not stand by and protect that host. Add insult to injury, the customer service rep I spoke with was downright rude and insensitive; it was by far the worst customer service experience I’ve ever had.
Airbnb: You got it wrong! So much for helping Superhosts with a fairer review policy!! Tell me what I could have done to earn a rating consistent with my previous ratings? Am I suppose to be standing beside the guest as they read the listing description or their messages to ensure they fully understand the check in and check out policy. Am I suppose to go track down the guest and force them to stay in the space which they booked? It’s ludicrous. Airbnb, you are failing hosts: the people who go out of their way to provide the service you’ve promised travellers, and who have made your upcoming IPO worth Billions. It’s time for Airbnb to protect their hosts from one off outliers like this!
Communication:
I received a 1-star for “Check-in”, a 2-star for “Communication”, and an overall 3-star Rating.
Below is the communication chain. George booked his stay last minute on Apr 2, 2019 when I was already asleep. When I woke up the next morning, I immediately responded and reminded him of our check in time of 4pm, since he was asking for a 2pm check in time. Instead of acknowledging the check in policy, he showed up in town expecting to be let in at 2pm. As the communication shows, I explained to him I could not be flexible because we have a cleaner who comes in to clean the studio in between guest visits. George sent a final message asking me ‘if someone stayed there the night before’. I did not respond to this message because it was implied in the previous message, and quite frankly, it is a privacy issue: it is not George’s (or any guests) right to know whether a guest stayed there the night before. It is my home and I take my guests safety and security seriously. I also take my family and my own safety and security just as serious. I will not be made to feel like I did something wrong by not justifying the question with a response. I had already made it clear that I could not accommodate the earlier check in because the cleaner would be there - whether someone stayed there the night before is of no relevance.
Finally, the sad part of this is I have accommodated many early check in's or late check out’s. Given the late booking by George and my cleaning situation, I could not accommodate, otherwise I would have. But, the fact remains: I cannot control a guest and what they read or choose not to read, yet Airbnb feels that it is okay for a guests incompetence to be my fault and a allow a 3-star rating to stand?
Airbnb, you’ve made me seriously question your ethics and integrity as a company. You’ve made me seriously question why I as a host should continue to go to the lengths I do to provide a first class experience, if you are going to allow hosts to be penalized for something they don’t control. Based on this, I’ve decided to shut my Airbnb account down, seeking alternate options to control my destiny without your service.
Initial Message from George:
Visiting from Toronto with my girlfriend. Would like to arrive shortly after 2pm.
2 Apr 2019
My initial Response to George:
Hi George!
Thank-you for booking a stay at Studio 620! We look forward to hosting you and below is information to help you prepare before you arrive.
Our guests gain access to our home by a Smart Lock. It’s simple to access and download. Whether you have an iPhone or Android, go to the App Store and download August Smart Lock. It will ask you to create a profile and confirm information by text and email. You should have been sent instructions to the email you used to sign up with on Airbnb from August. If not, please let us know.
If required, you can send us your mobile number and we will add you to the door before your arrival.
If we are not home when you arrive and you are having difficulty with the lock, there is a traditional lock box beside the doorbell.
Finally, our internet is Studio620 - Guest and the password is Travel2018.
Unfortunately, check in is 4PM onward. We are looking forward to your arrival. If you have any questions, just let us know.
Thanks,
John & Riley
3 Apr 2019
Second Message from George:
Hi John. I’m in town and I understand check in is at 4 PM, but would really appreciate it if we could get in there earlier. Most places we stay at are 2pm check in and we didn’t realize yours was much later. Sorry to bother just thought I would check again. Please let me know if that is ok. Thank you so much
3 Apr 2019•Sent from a mobile device
My response to George:
Sorry George, I can’t accommodate. Check out for us 10am and require that window for our cleaner. The earliest you can check in is 4pm. See you then.
Thanks,
John
3 Apr 2019
George’s last message (which I did not respond to for reasons already stated above):
Did someone stay there last night?
3 Apr 2019•Sent from a mobile device
In essence, John of Peterborough encapsulates many if not most of the hosting issues described.
Guests make up their own rules and expect the host to comply. Guest has a hissy fit when they don't have their way and gives an exceptionally high metric host low marks. Air stays the review.
A couple more of those and a perfectly decent host could not only lose SH status, but be off platform!
Try that at the Sheraton.
John Smith is proud of his work. On any other website, a review total of 4.2 or higher would be phenomenal. He's got a perfect or near perfect score, until the Georges of the world become unreasonable. Air sets a ridiculous standard, but ignores common sense.
What should have happened was that Air sheuld have supported John because George broke the rules. End of discussion.
All guests should be prompted to give an explanation for every rating less than 5 - like why start at 3? The issue that airbnb system is not as similar as to a Hotel stars ratings must be exhorted somehow. 4 stars is not a good review on Airbnb, while on hotels is an excellent one. Asking the question “what is that you didn’t like” for less that 5 stars would be a good start.
I don't think guests realise that 4 stars or less on AirBnB is a death sentence. I've never seen a host with less than an average of four stars (which would be considered a decent review in other industries)
Happy guests may give 4 stars thinking they are being helpful and not realizing they're killing us. Hosts can't appeal these reviews, they can't see of the guest is a chronically negative reviewer, and ALL hosts give the guest the benefit of the doubt and award 5 stars. LET THE HOST AND GUEST SEE EACH OTHERS REVIEWS AGAIN WITH THE FREEDOM TO EDIT!!!!!!!!!!
@Airbnb wrote:
Many of you have asked us how Airbnb can protect hosts from one-off bad reviews. When this question came up at the most recent Host Q&A, we told you we were working on ways to make the review process more fair for hosts. Specifically, we made 2 promises:
- We committed to launching a tool to detect outlier reviews—or one-off bad reviews. A common example is when there’s a discrepancy between the overall rating and the category ratings provided by a guest (when a guest gives a host 5 stars for cleanliness, accuracy, and the other categories but a 2-star rating overall, for instance).
- Based on your feedback, we also committed to exploring ways to help guests better understand that the location category rating is mean to be objective. The location category rating doesn’t impact your overall rating (or Superhost status), but we know it’s important to you, and we want to make sure the whole system is as fair as possible.
Today, we’re excited to announce two improvements to the review process that directly address these issues. Since these changes have been introduced, we’ve already noticed a tangible uptick in more accurate, fair reviews for hosts, and we hope they solve some of your pain points. Here’s what’s new:
One-off review alerts
We’ve added a step to the review process for guests when they give a host an inconsistent overall rating. For instance, the guest may have given 4-star or higher ratings for all the categories (cleanliness, accuracy, etc.), but then give an overall rating of less than 3 stars.
The new pop up screen asks guests: “Is this right?” And goes on to explain that they rated their overall stay lower than they rated it in specific categories. It gives guests an option to either change the rating or ignore the alert.
This new alert has led to higher overall review ratings for hosts. Since we launched, we’ve seen a 2.8% drop in 3-star reviews and a 3.9% drop in 2-star reviews. While these percentages may seem small, they’re driving real improvements in the accuracy of our review system, and hosts are benefitting.
Location, location, locationWe’ve heard from you that the location rating can be particularly frustrating because some of you have experienced guests dinging you in this category, unexpectedly, after great stays. This category is tricky. It gives valuable information to prospective travelers, which we don’t want to lose. At the same time, we hear your concern that you’re being graded for something you can’t control: guests’ opinion of your location. This opinion is inherently subjective—one person’s “rustic rural retreat” may be another’s “too far from public transportation.” So we made it more clear in the review process that guests are rating the accuracy of your location description, rather than the location itself.
Now, when a guest goes to rate you in the location category, if they give you less than 3 stars, they see an explanation: “Was the listing’s location not described accurately?” So far, this has led to a 0.8% increase in the average rating for location.
While we were working on this, we also made similar improvements to the value category. If a guest gives you less than 3 stars there, they’ll see this message: “What would have made this listing a better value?” This has led to a 0.25% increase in the average rating for value.
These changes were designed to begin to address your concerns around unfair reviews, and to help make sure that guests understand what ratings mean. We still have a journey ahead of us to keep making the review system better, and you’ll continue to see updates from us on this throughout the year. Thank you for hosting!
@Airbnb wrote:
Many of you have asked us how Airbnb can protect hosts from one-off bad reviews. When this question came up at the most recent Host Q&A, we told you we were working on ways to make the review process more fair for hosts. Specifically, we made 2 promises:
- We committed to launching a tool to detect outlier reviews—or one-off bad reviews. A common example is when there’s a discrepancy between the overall rating and the category ratings provided by a guest (when a guest gives a host 5 stars for cleanliness, accuracy, and the other categories but a 2-star rating overall, for instance).
- Based on your feedback, we also committed to exploring ways to help guests better understand that the location category rating is mean to be objective. The location category rating doesn’t impact your overall rating (or Superhost status), but we know it’s important to you, and we want to make sure the whole system is as fair as possible.
Today, we’re excited to announce two improvements to the review process that directly address these issues. Since these changes have been introduced, we’ve already noticed a tangible uptick in more accurate, fair reviews for hosts, and we hope they solve some of your pain points. Here’s what’s new:
One-off review alerts
We’ve added a step to the review process for guests when they give a host an inconsistent overall rating. For instance, the guest may have given 4-star or higher ratings for all the categories (cleanliness, accuracy, etc.), but then give an overall rating of less than 3 stars.
The new pop up screen asks guests: “Is this right?” And goes on to explain that they rated their overall stay lower than they rated it in specific categories. It gives guests an option to either change the rating or ignore the alert.
This new alert has led to higher overall review ratings for hosts. Since we launched, we’ve seen a 2.8% drop in 3-star reviews and a 3.9% drop in 2-star reviews. While these percentages may seem small, they’re driving real improvements in the accuracy of our review system, and hosts are benefitting.
Location, location, locationWe’ve heard from you that the location rating can be particularly frustrating because some of you have experienced guests dinging you in this category, unexpectedly, after great stays. This category is tricky. It gives valuable information to prospective travelers, which we don’t want to lose. At the same time, we hear your concern that you’re being graded for something you can’t control: guests’ opinion of your location. This opinion is inherently subjective—one person’s “rustic rural retreat” may be another’s “too far from public transportation.” So we made it more clear in the review process that guests are rating the accuracy of your location description, rather than the location itself.
Now, when a guest goes to rate you in the location category, if they give you less than 3 stars, they see an explanation: “Was the listing’s location not described accurately?” So far, this has led to a 0.8% increase in the average rating for location.
While we were working on this, we also made similar improvements to the value category. If a guest gives you less than 3 stars there, they’ll see this message: “What would have made this listing a better value?” This has led to a 0.25% increase in the average rating for value.
These changes were designed to begin to address your concerns around unfair reviews, and to help make sure that guests understand what ratings mean. We still have a journey ahead of us to keep making the review system better, and you’ll continue to see updates from us on this throughout the year. Thank you for hosting!
I have been hosting for some years with Airbnb. I was one of the hosts that raised the issue of individual gradings not being reflected in the overall grading. I am pleased with the change. My other issue is similar to the location issue. I do not supply bed linen, towels, sheets or tea towels. I find it is easier asking guests to bring their own and many of my guests like this. I boldly state in my listing that I do not supply these items and remind guests of this fact in all my communications. I still however get negative gradings because of this. This frustrates me as I feel that, if this was going to be an issue, then please don't book my property.
@Patrick844 I respectfully disagree- I think that the fact that reviews are blind is one of the only things about the Airbnb review system that makes sense. Reviews are meant to be honest and a reflection of the host and the host's property, and of the guests, as we each experience each other throughout the course of booking, check-in and out, and stay. No, all hosts don't rate all guests 5*s- I'm not sure where you got that idea- many hosts are, thankfully, honest in their reviews of bad guests.
If we experience a guest as good during the course of dealing with them and write an honest review to that effect, changing that review based upon what the guest wrote after they left would in fact, be dishonest. If a guest lies in their review, has a litany of complaints that they never mentioned during their stay, yes, it's a piss-off, but if the host has been honest in their review of the guest, that review is still valid. That the guest may have a vindictiveness which wasn't evident during their stay, or a need to complain after the fact, are things we can't anticipate, therefore can't comment on when writing the review. The fact that we can leave a response to their less-than-good review is fair- that's where we can correct lies told, or express some shock or confusion that the guest said that all was fine during their stay, and then turned around and stabbed us in the review.
Almost all of the issues around reviews could be solved by Airbnb being consistent in how they present the star ratings to the guests and applying them to the hosts. If they tell the guests that 4*s indicates Good, then turn around and threaten to delist hosts for a less than 4.7 rating, that is just insane and evil. If they got rid of the star ratings entirely, and only offered written reviews, that would also work. And if they were responsive to looking at a host's review history, and acknowledging that a bad review claiming the place was filthy or that the host was inattentive to their needs, when that host has scores of glowing reviews stating exactly the opposite, and easily agreed to remove the obvious lying review, instead of insanely claiming it's a true reflection of the guest's experience, that would also solve the review problems.
This is a lot of input to digest here but I am trying. I have had similar frustrations with a few guests but never had any rating under a 4, hence my super host status for the past 3 terms BUT I am worried nonetheless. Recently a guest and her husband and dog came and stay only one of the 3 nights booked. Never had this happen.
I allowed the dog to stay after proof of flea treatment and the $50 deposit for first time dogs. Future stays with the same dog cost nothing. THE GUEST KNOWS THIS AHEAD OF TIME and has the option to pick my home or go somewhere else. My house rules say they must seek permission BEFORE booking. These guests were booked for 3 nights. The woman shared with me she had had a terrible flu bug prior to the reservation but was "OK' for the trip (which was maybe 50 miles from their home in Portland). I went to clean the house after previous guests and had someone in that group spill something in the oven so when I turned the oven on the NIGHT BEFORE, there was a slight oven smell. I changed out the liner, opened the house up and baked a loaf of fresh homemade bread in that oven. (It's only 2 years old and high end). I met them at the house, let them check in early and off I went. about 30 hours later she text me they had to leave because of her illness and the funky smell from the oven-even though there was absolutely no smell at all. I sensed she wanted a refund for the 2 nights not spent but I am not into doing that since you can't make the days up. I went out there to clean up and found BOTH double beds had been slept in for one night, a huge pile of towels used for one night but I took it in stride and cleaned up for my next group. She waited 6 days to post a review today and to be honest, I am afraid to leave them one so I can see what she wrote. I went above and beyond in accommadating their needs but she was ILL. If that transfers to my review site with airbnb, I am going to be really pissed. I work my ass off to make this place a wonderful rental (it is full of leaded glass, antiques, bamboo floors and pure charm. "Normal" people love it (and I have several return guests coming again this spring and summer which speaks volumes!)
So what happens when someone is ill and tries to make it sound like they left because of a "funky smell" that did not actually really exist?
I like the strategy of not posting the review. That way, you don't risk anything.
@Craig-and-Anita0 What are you talking about?The guest's review gets published whether a host leaves a review for that guest or not. You avoid nothing by not leaving a review, all you've done is fail to warn other hosts of a bad guest who they wouldn't want and you would never want to see again.
Why not base the review score on how the guests rate the property for each particular topic, rather than the one score for the overall stay. I have had two instances of good scores for each topic and then only a 3 overall - it dosn't make sense.
It's heartening to see that AirBnB are making changes in response to significant pressure. It's also obvious that there is no significant consultation with Hosts before making changes. There are plenty of excellent suggestions here in this thread that would make a real difference to the quality of the Air experience for Hosts and Guests alike. These suggestions are not going to be instituted any time soon as changes have just been made. This lack of involvement of Hosts at a planning stage only highlights how little value Air actually places on their Hosts.
I'm still fuming at the removal of Guest details at booking time. I agree that Host discrimination should not be tolerated BUT - Guests can see full Host details and can discriminate if they choose. That is not a fair or balanced situation. Many Hosts are opening up their homes and personal space to Guests so I really want to feel comfortable with the people coming to stay. And there is still no action regarding information on those accompanying the person making the booking. AirBnB - Many of your Hosts are NOT hotels. We are opening our doors to strangers and your procedures are not supportive.
I would like to share that Airbnb didn't like my comment and has not allowed its publication.
@Airbnb wrote:
Many of you have asked us how Airbnb can protect hosts from one-off bad reviews. When this question came up at the most recent Host Q&A, we told you we were working on ways to make the review process more fair for hosts. Specifically, we made 2 promises:
- We committed to launching a tool to detect outlier reviews—or one-off bad reviews. A common example is when there’s a discrepancy between the overall rating and the category ratings provided by a guest (when a guest gives a host 5 stars for cleanliness, accuracy, and the other categories but a 2-star rating overall, for instance).
- Based on your feedback, we also committed to exploring ways to help guests better understand that the location category rating is mean to be objective. The location category rating doesn’t impact your overall rating (or Superhost status), but we know it’s important to you, and we want to make sure the whole system is as fair as possible.
Today, we’re excited to announce two improvements to the review process that directly address these issues. Since these changes have been introduced, we’ve already noticed a tangible uptick in more accurate, fair reviews for hosts, and we hope they solve some of your pain points. Here’s what’s new:
One-off review alerts
We’ve added a step to the review process for guests when they give a host an inconsistent overall rating. For instance, the guest may have given 4-star or higher ratings for all the categories (cleanliness, accuracy, etc.), but then give an overall rating of less than 3 stars.
The new pop up screen asks guests: “Is this right?” And goes on to explain that they rated their overall stay lower than they rated it in specific categories. It gives guests an option to either change the rating or ignore the alert.
This new alert has led to higher overall review ratings for hosts. Since we launched, we’ve seen a 2.8% drop in 3-star reviews and a 3.9% drop in 2-star reviews. While these percentages may seem small, they’re driving real improvements in the accuracy of our review system, and hosts are benefitting.
Location, location, locationWe’ve heard from you that the location rating can be particularly frustrating because some of you have experienced guests dinging you in this category, unexpectedly, after great stays. This category is tricky. It gives valuable information to prospective travelers, which we don’t want to lose. At the same time, we hear your concern that you’re being graded for something you can’t control: guests’ opinion of your location. This opinion is inherently subjective—one person’s “rustic rural retreat” may be another’s “too far from public transportation.” So we made it more clear in the review process that guests are rating the accuracy of your location description, rather than the location itself.
Now, when a guest goes to rate you in the location category, if they give you less than 3 stars, they see an explanation: “Was the listing’s location not described accurately?” So far, this has led to a 0.8% increase in the average rating for location.
While we were working on this, we also made similar improvements to the value category. If a guest gives you less than 3 stars there, they’ll see this message: “What would have made this listing a better value?” This has led to a 0.25% increase in the average rating for value.
These changes were designed to begin to address your concerns around unfair reviews, and to help make sure that guests understand what ratings mean. We still have a journey ahead of us to keep making the review system better, and you’ll continue to see updates from us on this throughout the year. Thank you for hosting!
How can guests be fair enough in their comments/reviews to hosts, when Airbnb doesn't even show any care supporting hosts in their enormous dedication for setting up and sharing cosy homes for guests?
It is completeley disappoiting how unsympathetic and dispassionate Airbnb acts when it comes to solving issues that affect our work as hosts and are a part of Airbnb's responsibility (i.e. the platform, the reviews). Other than that, if Airbnb would have genuinely cared about the fairness/unfairness of guests' reviews, the matter should have been addressed ages ago in a much more specific way.
To begin with, not all guests have the same experience in Airbnb to understand and appreciate the way it works. Thus, many reviews are completely subjective and unfair. Many guests are just seeking a better price than a hotel and are judging the whole Airbnb experience unfairly from a completely different way of seeing things. Others, have only had 1 or 2 Airbnb experiences and still think the 'extras' offered to make their stay easier and more practical is a 'must', and they even think many of the 'extras' are to take back home (i.e. some even take a full bottle of olive oil back home wihtfter a 3-day stay!). So what useful or fair feedback can you expect from them?
It is the host's job to create and offer a warm adequate home/experience for the guest.
However, making guests aware about what the Airbnb experience really means, and putting things into the right perspective, is Airbnb's job.
And making the platform work adequately, addressing issues that don't work well, is Airbnb's job too.
So far, the business seems to have worked for some under an uneven relationship led by guests' subjectivity and unawareness, while hosts worked madly to earn a star.
A complete irony, if you consider the host and their listing, as the essence of this business.
@Airbnb wrote:
Many of you have asked us how Airbnb can protect hosts from one-off bad reviews. When this question came up at the most recent Host Q&A, we told you we were working on ways to make the review process more fair for hosts. Specifically, we made 2 promises:
- We committed to launching a tool to detect outlier reviews—or one-off bad reviews. A common example is when there’s a discrepancy between the overall rating and the category ratings provided by a guest (when a guest gives a host 5 stars for cleanliness, accuracy, and the other categories but a 2-star rating overall, for instance).
- Based on your feedback, we also committed to exploring ways to help guests better understand that the location category rating is mean to be objective. The location category rating doesn’t impact your overall rating (or Superhost status), but we know it’s important to you, and we want to make sure the whole system is as fair as possible.
Today, we’re excited to announce two improvements to the review process that directly address these issues. Since these changes have been introduced, we’ve already noticed a tangible uptick in more accurate, fair reviews for hosts, and we hope they solve some of your pain points. Here’s what’s new:
One-off review alerts
We’ve added a step to the review process for guests when they give a host an inconsistent overall rating. For instance, the guest may have given 4-star or higher ratings for all the categories (cleanliness, accuracy, etc.), but then give an overall rating of less than 3 stars.
The new pop up screen asks guests: “Is this right?” And goes on to explain that they rated their overall stay lower than they rated it in specific categories. It gives guests an option to either change the rating or ignore the alert.
This new alert has led to higher overall review ratings for hosts. Since we launched, we’ve seen a 2.8% drop in 3-star reviews and a 3.9% drop in 2-star reviews. While these percentages may seem small, they’re driving real improvements in the accuracy of our review system, and hosts are benefitting.
Location, location, locationWe’ve heard from you that the location rating can be particularly frustrating because some of you have experienced guests dinging you in this category, unexpectedly, after great stays. This category is tricky. It gives valuable information to prospective travelers, which we don’t want to lose. At the same time, we hear your concern that you’re being graded for something you can’t control: guests’ opinion of your location. This opinion is inherently subjective—one person’s “rustic rural retreat” may be another’s “too far from public transportation.” So we made it more clear in the review process that guests are rating the accuracy of your location description, rather than the location itself.
Now, when a guest goes to rate you in the location category, if they give you less than 3 stars, they see an explanation: “Was the listing’s location not described accurately?” So far, this has led to a 0.8% increase in the average rating for location.
While we were working on this, we also made similar improvements to the value category. If a guest gives you less than 3 stars there, they’ll see this message: “What would have made this listing a better value?” This has led to a 0.25% increase in the average rating for value.
These changes were designed to begin to address your concerns around unfair reviews, and to help make sure that guests understand what ratings mean. We still have a journey ahead of us to keep making the review system better, and you’ll continue to see updates from us on this throughout the year. Thank you for hosting!
Let's be frank, guests choose to stay in a certain location/ neighboorhood according to their wallet. I feel that from the moment they made that decision they should not turn around and poorly rate the location that they chose to stay in. Each neighborhood is different. Harlem is different from Time square, Chelsea and or Brooklyn area.
Agreed. Many people have suggested modifying the question to something along the lines of "did this location meet expectations". I live close to the industrial section of a city that had a reputation as Ontario's armpit. It's low crime but dreary. Its also undergoing a renaissance fiscally and is walking distance to a world biosphere, but "kick me" is written all over location. So what I did was to describe it in sordid detail, including the crack house three doors down (it got sold- yay!). There is something to be said for brutal honesty. No illusions .And I never get lower than a 4.