Plus, when the client sees you will be taking voice notes throughout the inspection, they know they need to clam up

.
I wouldn't necessarily look at the chit-chat as a bad thing John. If your clients didn't like or trust you, they wouldn't chat you up too much. Engaging in other topics of conversation with the client aside from just inspection related stuff helps your clients see that you have a life, a personality, and a sense of humor. Building this type of rapport can go a long ways towards establishing a referral base for future business. Plus, I firmly believe that if past clients like you and feel you are looking out for their best interests, they are less inclined to hold your toes to the fire if they feel you might have missed something during their inspection. I'm not saying being nice and personable is a get-out-of-jail free card but it can help reduce callbacks on the little things.