Freedom of speech includes the right to spend money as one sees fit. Same goes for businesses and PACs. See Citizens United v Fed, a case from 2010 that ruled in favor of the conservative group, Citizens United for funding an anti-Hillary documentary during the 2008 primary.
The conservative position isn't one where the government gets to decide where money can or can't be spent, regardless of whether it is spent on Demoncrats or conservatives.