You don’t experience the isolation. That doesn’t mean that denigrating you for your ancestry suddenly becomes acceptable. It is racist, and, furthermore, the prevalence of anti-white racism, even when not directed at mixed-race people, is still harmful to mixed-race people.
But it’s not especially harmful to white people. That’s the point. You laid it out so perfectly that I don’t feel like I have much more to add to be honest.