Blacks were elected to Congress after the Civil War.
Now that I think about it, you are correct. Fredrick Douglas is one that comes to mind.