Stupid guy purposely bump shoulder and kept walking?

So I had a long overtime shift and I am coming home wearing my nice muscle t-shirt and in a subway station walking to my platform and as I am walking, this guy wearing glasses purposely bumps his shoulder into me real hard and as I turn around he keeps walking. I could've easily kicked his *** but it was late at night tired from work and there were cops few feet away chatting with each other, i kept walking because i try to avoid confrontations at all cost because it's not worth it, i know i can beat the crap out of him so I swallowed my pride and kept walking to my train then it kept bugging me because i know i did the right thing at the same time i feel frustrated for not kicking his ***, its like he was jealous or wanted to prove he is tougher or somesh*t, now its bugging me, did I do the right thing by walking away?