XKCD: An Idealological History of the US Congress

I have to wonder if you could properly call the Republicans of the US Civil War and immediately afterwards 'right leaning.'