The old days of bed and breakfast had the land lady at the front door chucking everyone out at 9.00am and not allowing anyone in til after 5.00pm.
God help anyoneone breaking those rules as a swift blow with the rolling pin would reinforce the memory
Hah them were the days, remember them well.
But nowadays guests come and go as they please, often having their own front door key and the freedom to do as they wish.
Have found that if guests book for a duration of 2+ days then they do expect to be able to use the room as they please.
Besides where would they go if it was thundering down with rain etc. would you still chuck them out?
But as @Paul154 says, your home your rules