You didn’t know .... You can ban anyone you want ...thats right all you have to do is type in the one you want to ban then press on your keyboard Alt and F4..give it a try....
So that's what I was doing wrong! I was hitting Alt + F5, and that was replicating them!