I think it was less overt racism, but still pretty racist.

But mostly because Classism and Racism were pretty intertwined back in the day, what with non-white people essentially being entirely disallowed from actually being a higher class.