As people of color, the idea leaked into our lives even though we aren’t privy to the same advantages of being white