I don't see any reason why disclosing the facts would be a problem. I wouldn't hide the fact that you know the seller. Just tell the buyer/client the truth and let them decide for themselves if it's a problem.
If they have any reservations, then they can get another inspector and you're off the hook.

Dom.