If you didn't listen to them, and instead pushed them away, they didn't cost you the Senate.
Pushing away those who would be your allies (not just Libertarians, but all true conservatives) is what cost you the Senate -- and the House -- and failing to keep the promises you made to those who trusted you.
We are NOT your enemies, but as long as you treat us like enemies, you will get what you ask for.
Now I have a problem with you.