Not having ever been at a convention, I can't relate; but I have ready literally hundreds of SF novels in my younger days, and met dozens of likeminded SF fans who dismissed fantasy in a heartbeat. Sword and sorcery stuff...
I'm not a fan of S&S either.