Yes, ITA. I think often people just want their house of choice to be the anarchy house when it sounds cool. But from what we've seen I see it exactly as you do--Slytherin=classist Conservative, Gryffindor=Populist conservative. Though of course individuals from any house could be anything.