Don't sweat it. It's a minor issue. Airbnb doesn't count the location or value rating in any way that affects hosts. Plenty of hosts get less than 5* location ratings, when, just like you, they have accurately described it. My only 4* location rating was from a guest who specifically asked me how far it was to the place she was taking a course to my place which I told her quite accurately.
And I remember a post from a host on a thread here about location ratings (there have been several- do a search) who had a stunning, modern place on a hilltop overlooking miles of pristine beach in the Philippines, complete with infinity pool, who said he regularly got low location ratings because guests got fussed that it was a 10 minute drive to the nearest grocery store.
@Jillian115