Fellow VIRGINIA CCW holder.. was I in the right to have my firearm at my side? Had an altercation last night.

Alright well I’ll try and keep this short and sweet.Last night my wife and I go to a dinner date. I have a Virginia CCW license (didn’t go through any class as I’m military) just signed up. We are at the parking lot of the restaurant and I find a parking spot. This guy immediately starts trying to block me with his car. I was confused but I kept pulling into the spot.When I’m parked he gets out of his car that’s blocking me in the front. My wife is in the passenger side scared as hell and I see him and immediately glance at his hands to see if he has a weapon. It’s night time so I bring my CCW out and keep it at my side where no one would notice unless the lights were on. He BANGS on my window and my dumbass lowers it down to say “sir I have a weapon and if I fear for my life I will use it”My dumbass gets cold feet thinking “shit can I even say that? Should I even have my weapon out” I have a government job that took forever to get so I didn’t want to risk anything. He starts yelling at me extremely pissed so I roll my window up. He GETS to his car and blocks me some more. Then comes back out I’m thinking this is it. Bangs on my window again and I didn’t lower it down I just sat quietly at this moment with my CCW at my side.He leaves. Flips me off. Drives away and then I drive away as I’m not taking any chances with my wife with me. Questions I have.Should I have said “sir I have a weapon and if I fear for my life I will use it, I don’t want any conflict”Was I in the wrong in the get go to even have it out? Or should I have put it on my lap so he could see it clear as day?So many questions. I’m so glad nothing happened man. Thanks for any help! via /r/CCW https://ift.tt/2NSQRYv