Did your key work Cat? to my way of thinking this key issue will open a Pandora's box.
I must say it's not the decision I would have made in your Guest position, I would have contacted the Host considering that all my luggage was in your property and I'd want to insure I wasn't scammed.
The whole think sounds fishy to me
It's was his decision to book an Hotel so in my opinion he should pay for it.
I got up at 04:00, 05:00, 06:00 to collect keys when Guest were leaving being disturbed at 23:00 would be an absolute luxury!
Regards
Cormac
The Explorer's Club Krakow III