It is my understanding that the location rating is not used in any of the algorythms. This was discussed in the last Airbnb Q & A.
If people are leaving comments in their review about the location, then counter the comment with something positive. If it's just a star rating, don't worry about it.