I guess some people see things in terms of "sides", I don't. Those people try to define things in terms that set you on a side, or guilt you to a side, but I'm not bothered by their definitions, never mind where their definitions might put me in their heads.
I like to think that I can look at something objectively and come to my conclusion of right/wrong. That's all I got, my conclusion. I can try to explain it and others can agree or not, or just ignore me.
I'm not someone else's label though. So colorblind, to me, just means people. If it means something else to someone else, then OK - that's them.