when you think about language how does any of it make sense? Why is a fork called a fork? How do we all know that fork means what it does?

Language takes its power from the belief that people place in the meaning. I don't know whether not saying 'white' person will solve the problems, but I see your point about essentially removing the power from it. And although it may seem like a small impact because maybe it's just you, who knows whether others will follow and start challenging the false beliefs around a race based hierarchy which still permeates our societies.