Not sure if it is possible to go back to "unlisted". However you can block all dates moving forward. Just go into availability settings and put "unavailable as default". That way nobody can book or even request dates. You can also "snooze" your listing (over on the lower left of the same page). You can set dates for that. When you snooze it, it won't show up at all in searches.