No, it doesn't. It just means you were playing the game on an easier setting. People can still win the game if they work hard enough. It's just a lot harder if your race (or gender, or sexual orientation, or religion) sets the difficulty to "hard."
I had several benefits when I was born based purely on what race I was, what gender I was, where I was born, who my parents were, what my genetics were and what sexual orientation was. I did not squander those benefits and worked hard to get where I am now. But it was absolutely easier for me than for someone who was born black in the US, or born in Nigeria, or born to drug addicted parents, or born with a cleft palate.