Can a bouncer physically remove me from a bar for wearing a white T shirt?

I was at a bar enjoying happy hour with some friends. I had a bouncer approach me and tell me, "sorry, but... we have a policy against wearing plain white t shirts... please but your coat on or you'll have to leave. I thought he was joking but he wasn't. It was hot in the bar and I didn't want to put my coat on and look like an idiot. I ended up putting on a friends vest to avoid a scene. Could he have phsycally carried me out of the bar for wearing a white T??