Odd sort of ethical connundrum

[charliesmum]

So, we're watching Wheel of Fortune, and of the three contestants, one was African American. At the end of the show, Charlie says, 'The brown-faced boy didn't win anything.' He's used 'brown-faced' before in describing people, but it's a fairly new thing.

I don't personally see anything wrong with it. I am confident that Charlie makes no distinction between people other then what their personality warrants, but I'm wondering, do you think it could be construed as rude or offensive? Should I correct him? What would I say?