Your guest is correct - Airbnb does not require them to provide the host any additional information. You accepted the reservation with the information provided on the profile. If you would only like guests with more verifications, you need to request guests complete their profiles and verifications before accepting their reservations.
If you are intent on receiving guest's address and additional information, you need to CLEARLY put that in your listing so potential guests are aware you may request additional information from them after they book. If nothing was in your listing about this practice, the guest is not obligated to provide it.
If you are absolutely positive you feel uncomfortable with this reservation, you need to contact Airbnb directly by phone (you can search for the number here in this community) and proceed with cancelling the guest's reservations (which may come with PENALTIES to you, FYI)
Airbnb works much differently than many other listing sites, best you learn the lay of the land before accepting more reservations.