Then to drop a bomb shell, among your fellow Libertarians you get to include Noam Chomsky. Not only because that is what he self-identifies as, but primarily because the root word of Libertarian is liberty, which is the focus of Libertarianism. However, right-Libertarians and left-Libertarians do not agree over the means and methods to maximize and best preserve individual liberty for all.
Just because some black people defended slavery and the societal ideas that black people are inferior to white people doesn't make slavery and such views not racist. The "Uncle Tom" character archetype has survived and still used for a reason.
They aren't uncle toms. They're just smart enough to recognize Trump isn't racist.
Maybe you're racist to suggest a black person who disagrees with you must be an Uncle Tom. Shameful!