Can't believe I forgot the House of Freaks, from the late 80's and early 90's, the epitome of overlooked bands. A two person outfit long before the White Stripes came on the scene. Three strong albums and a fourth that had its moments. A sample from each album:
Crack in the Sidewalk
Big Houses
Never
Whipping Boy