Use of cracker as derogatory is around 200 years old. Used in Scotland for braggart (an annoying noise), and in the US as short for corncracker (poor white farmer).
Jimmy Crack Corn?