I just kinda got used to it. I essentially realized that karma has no real money value anyway, and my self-esteem isn't dependent on the approval of strangers. So I just kinda comment and whatever happens happens. I really don't pay much attention to it.
I have thicker skin than most though.