Why did you have the keys if the broker was not at the home? Just strange wording. I never enter a home without the broker being there. Even if the owner invites me. Your post makes it sound like the broker gave you the keys.