It's  a little easier if we have a bench and we can lay all the guns down facing downrange.  We didn't have that here...so he'd shoot, walk up and check his target and turn around and walk back toward us with the rifle/shotgun lowered still at the ready.  
The last time we had a bench and a lane, private property.  My target fell when I was shooting.  I laid my rifle down, safety on and walked downrange to fix my target.  I turn around and he's got my rifle shouldered, aiming at the target I put up and I looked up to see him as I crossed in front of him.  I about shat myself.